Cognition· @cognition · X·· 3 小时前AI 评分48
AI 导读
FrontierCode 1.1 现已上线 @ArtificialAnlys！ FrontierCode 由开源维护者共同打造，是首个衡量端到端代码质量与可合并性的基准：维护者是否真的会合并这个 PR？
正文
FrontierCode 1.1 is now on @ArtificialAnlys!
Built with open-source maintainers, FrontierCode is the first benchmark to measure end-to-end code quality and mergeability: would the maintainer actually merge this PR?
Cost per Task on FrontierCode spans two orders of magnitude, from $0.09 for GPT-6 Luna (max) to $12.00 for Claude Fable 5.1 (max with fallback). Four models sit on the Pareto frontier for score vs. Cost per Task: GPT-6 Luna (max) at 42% and $0.09 per task, MiMo-V2.6-Pro at 45% and $0.18, GPT-6.1 Sol (max) at 49% and $0.81, and Claude Opus 5.5 (max with fallback) at 52% and $10.15. GPT-6 models led on token efficiency in our testing. GPT-6 Astra (max) and GPT-6.1 Sol (max) averaged 27k and 33k output tokens per task respectively, compared with 157k for Claude Opus 5.5 (max with fallback) and 236k for Claude Sonnet 5.5 (max with fallback).在 X 查看被引用的帖子
来源：Cognition · x.com