Diogo Almeida· @CompleteSkeptic · X·· 2 天前AI 评分25
AI 导读
再强调一下,我极度反对基准测试(: 引用推文例外处理——引用推文核心要点:别再搞“Jevbench”了,别再要求公开基准测试,它们完全没抓住Jevons悖论的重点,而且你不敢相信,你珍视的每一个基准测试有多容易被刷分。这是@CompleteSkeptic最惨痛的教训:选对任务胜过一切。
正文
to re-iterate, I'm extremely anti-benchmarks (:
STOP making "Jevbench"es, stop asking for public benchmarks, they completely miss the point of Jev and you won't believe how easy it is to game every benchmark you hold dear This is @CompleteSkeptic's bitterest lesson of all: picking the right task beats everything在 X 查看被引用的帖子
来源:Diogo Almeida · x.com