跳到正文
arXiv:cs.CL· William Sheffield, Jiahui Chen, Amy Zhang, Alex Warstadt, Junyi Jessy Li, Kanishka Misra·· 13 小时前

LLM 对 "just" 和 "only" 这类话语小品词的敏感度研究:一项案例研究

Not Just an Evaluation: A Case Study of Discourse Particle Sensitivity in Language Models

AI 导读

研究通过行为与机制分析发现,LLM 与人类都更偏好对话中出现 "just" 和 "only" 这类话语小品词,且对 "just" 比对 "only" 更敏感。指令微调会提高这种敏感度,"only" 的敏感单元能选择性迁移到排他性 "just",而所有 "just" 单元都能同等迁移到 "only",表明 LLM 的词级小品词表征部分按语义组织。代码、语义标注对话刺激和人类偏好标注已公开。

正文

View PDF HTML (experimental)

Abstract:Discourse particles subtly shape the flow of discourse by reflecting conversational context and interlocutor attitudes, often leaving the truth-conditional meaning untouched. They are also often polyfunctional, with distinct senses which partially overlap with other particles; for example, the exclusive use of English "just" and "only" ("John only/just drinks water"). Despite the frequency of these words in natural language, they have gone largely unstudied due to the subtle nature of their effects. We investigate LLM sensitivity to "just" and "only" in natural conversations using behavioral and mechanistic analyses. First, we find that LLMs and humans similarly prefer the presence of these particles in context, and both are more sensitive to "just" compared to "only". Second, when sampling from LLMs with and without these particles, we find LLMs consistently rate generations as more likely, given their source context, demonstrating their particle sensitivity. In both experiments, instruction tuning increases sensitivity. Finally, we localize particle-sensitive units within LLMs and find the overlap between "just" and "only" is asymmetric: "only" units transfer selectively to exclusive "just", while all "just" units transfer to "only" equally well regardless of sense, suggesting LLM lexical-level particle representations are partially organized by sense. We release our code, sense-labeled dialogue stimuli, and human preference annotations at this https URL.
Subjects: Computation and Language (cs.CL)
Cite as: arXiv:2610.13794 [cs.CL]
  (or arXiv:2610.13794v1 [cs.CL] for this version)
  https://doi.org/10.48550/arXiv.2610.13794

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Jiahui Chen [view email]
[v1] Fri, 9 Oct 2026 16:07:24 UTC (569 KB)

来源:arXiv:cs.CL · arxiv.org