Epoch AI· @EpochAIResearch · X·· 8 天前AI 评分39
AI 导读
AI 能看出你把宜家家具装错了吗？我们的新基准——家具组装基准（FAB）——给模型提供说明书和一张半成品家具的照片，让它们找出错误。 最高分在短短 10 个月内从 28% 提升到了 80%。
正文
Can AI tell if you've built your IKEA furniture wrong? Our new benchmark, the Furniture Assembly Benchmark (FAB), gives models the manual and a photo of a half-completed piece of furniture and asks them to spot the mistake.
The top score has gone from 28% to 80% in just 10 months.
来源：Epoch AI · x.com