Hugging Face· @huggingface · X·· 3 小时前AI 评分51
AI 导读
Hugging Face 在 Paper Pages(https://hf.co/papers)推出 ML Intern 论文复现功能,可让智能体独立复现已发表论文的实验。引用 @abidlabs 的分析指出,智能体加大规模算力正使科学发现的声望激励瓦解、低质量论文泛滥、公司更倾向保密,该功能旨在通过开放产物等信号帮助识别高质量研究,支持开放科学。
正文
Help keep science open, try this out on Paper Pages: https://hf.co/papers
🚨 The incentives to share scientific knowledge openly are crumbling. Historically, researchers shared scientific knowledge for two primary reasons: (1) the prestige conferred by discovery, and (2) a sense of expanding the pool of human knowledge. Even within industry, scientific discovery was far too vast an endeavor for a single scientist or team to tackle alone. So scientists explored different frontiers, usually published their findings, and collectively moved the field forward. However, as more scientific knowledge is uncovered simply by throwing massive compute at autonomous agents with minimal human intervention, these incentives are breaking down: (1) discoveries are becoming commoditized. If anyone could have found the same result simply by running the same agentic prompt with enough compute, the prestige of discovery and the pride in one's work disappears, a shift we are already witnessing in software engineering. (2) the explosion of low-quality, low-barrier publications makes genuine breakthroughs increasingly difficult to filter, discover, and appropriately credit. (3) and for companies, keeping discoveries proprietary is increasingly advantageous. Instead of publishing and waiting for the broader scientific community to build upon the work, an organization can simply turn its own compute back onto the problem to iterate faster internally. In the short term, the incentives reward secrecy. But my goal -- and at Hugging Face, our goal -- is the sustainable, long-term expansion of human knowledge that survives individual, closed companies. So we have to build new tools that reward and facilitate open sharing of knowledge. If agents are accelerating discovery, we are going to figure out how to use agents and other tools to preserve scientific integrity. Starting with this: Paper Reproductions with ML Intern -- we’ve made it possible to take a published paper and task agents with independently reproducing its experiments, helping create more signals (e.g. open artifacts) that can help identify high-quality work.在 X 查看被引用的帖子
来源:Hugging Face · x.com