语言模型中负责网络信息检索的注意力头与神经元定位研究

Authors:Abdul Kadir (1 and 2), Md Mohasin Hossain (2 and 3), Daniel Sonntag (1 and 2) ((1) University of Oldenburg, Oldenburg, Germany, (2) German Research Center for Artificial Intelligence (DFKI), Germany, (3) Saarland University, Saarbrucken, Germany)

View PDF HTML (experimental)

Abstract:We ask whether specific attention heads, and more finely specific neurons inside those heads, are responsible for recognizing that a language model's context contains network infrastructure information (a hostname paired with its IP address), and whether that responsibility can be validated causally rather than by correlation alone. At the head level the answer is yes, across five models spanning three architecture families: in every model, a small set of heads (1 to 9 out of 128 to 1152 candidates), found by causal ablation screening and tested for selectivity against matched negative and context-free controls, supports a detector with 99.5--100\% held-out accuracy. We then ask whether a head's responsibility concentrates into one neuron or stays spread across its dimensions; this is model-specific. In one model, the top head's signal concentrates into a single neuron, found independently by both a causal intervention and a correlational ranking, which agree exactly (AUC = 1.000, matching the full head). In another, the single clean head works as a whole (AUC = 1.000) but the best causally ranked neuron inside it does not (AUC = 0.665), so the responsibility there is spread across the head. The remaining three models fall in between. On an independent dataset collected by a different institution (reverse-DNS records rather than the discovery data), every model's full-head detector flags 100\% of positive records; the single-neuron versions transfer less reliably, and in one model score below chance. Causal head-finding for a specific network-information entity works across models and architectures; how far that finding can be pushed down to individual neurons varies, and needs to be checked for each model.

Submission history

From: Md Mohasin Hossain [view email]
[v1] Tue, 6 Oct 2026 11:51:03 UTC (47 KB)