Mark Zuckerberg 谈 Llama 系列在 Llama 3 之后为何受挫:Llama 3 是接近前沿的好模型,但 Llama 4 偏离了所需路径。他认为问题在于像 Instagram 信息流和广告业务那样组织研发,投入成百上千人并行工作,而前沿模型需要的是小而紧密的科研团队。
Mark Zuckerberg talks about why the Llama run broke after Llama 3.
says Llama 3 was a very good model and almost at the frontier, then Llama 4 fell off the path they needed.
His read is that he staffed it like Instagram feed and ads, with hundreds or thousands of people in parallel, when a frontier model needs a small tight science team.
"When you're an entrepreneur, you're building something, I think you kind of get tested in those moments because inevitably not everything is going to go well. And the things that kind of define the trajectory are, okay, if something doesn't go the way that you want, how do you basically figure out how to move forward?"
----
From "The Next Big Thing" YouTube channel, (link in comment)
来源:Rohan Paul · x.com