arXiv：cs.CL· Yi Gui·· 16 小时前
从效率到充分性：面向自动作文评分的成本感知测量设计框架（CAMD）
From Efficiency to Sufficiency: The Cost-Aware Measurement Design Framework for Automated Essay Scoring
AI 导读
论文提出成本感知测量设计（CAMD）框架，将自动作文评分（AES）重构为受成本约束的测量系统，包含计量、分配、单位经济与决策四层结构。该框架定义直接成本为货币支出加上可归属的人力与时间，并提出「每个可辩护分数的成本」（CPDS），主张以质量-成本充分性比较 AES 系统，且 CPDS 随评分规模变化而非单一可迁移数值。
正文
Abstract:Compute cost in automated essay scoring (AES) is usually treated as a technical efficiency issue rather than a measurement design concern. Yet deployment decisions require more than reporting latency, model size, or inference expense. In high-stakes settings, total burden includes validation, monitoring, adjudication, compliance, and governance; in instructional settings, pricing, licensing, and integration may dominate cost. This paper reframes AES as a cost-constrained measurement system and introduces the Cost-Aware Measurement Design (CAMD) Framework, a four-layer structure consisting of metering, allocation, unit economics, and decision, for translating computational and workflow resource records into decision-relevant cost constructs. Direct cost is specified as monetary outlay plus attributable labor and time, and two criteria, design attribution and auditability, determine what the cost boundary excludes. Burdens that satisfy neither criterion, such as institutional capability and governance posture, are represented as constraints on which designs are admissible rather than priced. The paper defines cost per defensible score (CPDS) and argues that AES systems should be compared by quality-cost sufficiency: minimizing cost among defensible scoring designs that satisfy measurement requirements. Scoring volume conditions all four layers, so cost per defensible score is treated as a function of scale rather than as a single transferable number. CAMD provides a portable basis for representing, comparing, and evaluating cost across AES studies and deployment contexts.
| Subjects: | Computers and Society (cs.CY); Computation and Language (cs.CL) |
| Cite as: | arXiv:2610.19287 [cs.CY] |
| (or arXiv:2610.19287v1 [cs.CY] for this version) | |
| https://doi.org/10.48550/arXiv.2610.19287 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Yi Gui [view email]
[v1]
Tue, 13 Oct 2026 23:05:19 UTC (296 KB)
来源：arXiv：cs.CL · arxiv.org