跳到正文

全部动态

今日 64 条
9月16日周三
  1. Satya Nadella32

    与@chamath、@jason、@davidsacks和@friedberg进行了一次精彩对话,讨论了在广泛传播AI红利、赢得社区许可、确保AI安全与可控方面,前方还有哪些工作要做。

    引用The All-In Podcast@theallinpod

    All-In Summit: Microsoft CEO Satya Nadella -- The AI Doomer Slowdown -- Common Sense AI Guardrails -- What "Slowdown" Means for New AI Products -- Microsoft’s Master Plan -- Who Wins AI (0:00) @satyanadella joins The Besties! (0:55) Dario's blog, "pacing the frontier," common sense AI safety (6:28) The failure of AI CEO messaging, monitoring agents, what will a slowdown mean for new AI products? (14:22) Economic incentives for frontier lab doomerism, where the AI profits are (22:45) Microsoft's master plan for AI, how they are allocating capital (31:00) China's slow down, changing AI perception, data center benefits $MSFT

9月15日周二
  1. Gary Marcus:The Road to AI We Can Trust(RSS)30

    Gary Marcus 解读 Sam Altman 的"pacing"表态

    Gary Marcus 解读 Sam Altman 在 X 上发帖中的措辞,将其"pacing"说法翻译为:我们会以最快速度推进,只要不进监狱、不被诉讼搞到公司消失,但为了观感,我们把它叫作"pacing"。Marcus 还指出,任何能减少监管不确定性的举措都可能有利于 IPO。

9月14日周一
  1. Gary Marcus:The Road to AI We Can Trust(RSS)35

    Gary Marcus 评特朗普 9 月 24 日与中国谈 AI 的抉择

    Gary Marcus 在 The Economist 撰文提出,特朗普与习近平 9 月 24 日通话将把 AI 列入议程,他认为这可能是特朗普任内最具影响的决定,主张美中不应只谈芯片交易,而应就"AI 向善"寻求合作路径。他同时提到,当前 AI 股票下跌、公众反 AI 情绪升温,部分前盟友如 Steve Bannon 已转向反对阵营,若市场与民调继续走低,特朗普的立场可能生变。

  2. Mustafa Suleyman36

    这是一个非常直白且符合常识的观点:技术的目的是服务人类,加速人类繁荣。 任何无法实现这一目标的技术都是失败的,应当被拒绝。 我们还没有到那一步。但开始为这种可能性做准备是正确的。

    引用Satya Nadella@satyanadella

    Any pursuit of superintelligence has to be grounded in the core principle that if the AI we build is not helping humanity and under human control, it's not worth pursuing. We also need to accelerate and spread the benefits of AI, such that they are diffused broadly across countries, communities, and companies. This requires a frontier ecosystem in which both closed and open-source models can thrive. And for firms, it’s imperative that they retain full control over their unique and tacit knowledge. Every organization should be able to build its own continuous learning loop/hill climbing machine, without becoming dependent on any one model provider, and have the ability to embed its own knowledge into models and weights they control. So, in this context, we welcome the research, focus, and deliberate pacing needed to get alignment right as the design goal. We also welcome ideas like "embedded evaluators" and the broader efforts to develop the mechanisms to make this more than just talk. The key is that this cannot be controlled by a handful of entities, but must have broad representation across the ecosystem, countries, and fields, including academia. This is the approach we are taking: broad access and choice at every layer of the AI stack; enterprise control of learning loops and models; and the “Code of Conduct” that underlies our own first party MAI models that we’ll publish tomorrow for public consultation.

  3. Gary Marcus:The Road to AI We Can Trust(RSS)67

    Gary Marcus 点评 Dario Amodei 的 AI 减速提案:三分肯定、七分质疑

    Gary Marcus 评 Dario Amodei 呼吁给 AI 发展减速的文章,Sam Altman 与 Elon Musk 已表态支持。Marcus 肯定其透明度承诺,但质疑其依赖与 AI 公司关系密切的 METR 做评估有监管捕获之嫌,指其拿中国当挡箭牌有损合作对话,并提出追责和产品召回等替代政策选项。文末提到特朗普反对减速,认为美国必须赢下 AI 竞赛。

    推荐理由:Gary Marcus 对 Dario Amodei 的减速提案给出有保留的支持,并指出监管捕获、追责与召回等被绕开的政策选项。

9月13日周日
  1. Peter McCrory68

    Peter McCrory 转发并推荐 Dario Amodei 的新文章《We Must Pace the Frontier》,该文主张 AI 行业应放慢速度并提出三步计划,Anthropic 单方面承诺其中第一步,即向第三方评估者提供永久、员工级别的系统访问权限,以便核查安全措施、报告事故和评估训练中的模型对齐。

    引用Dario Amodei@DarioAmodei

    We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: https://darioamodei.com/post/we-must-pace-the-frontier

  2. Aidan Gomez56

    Cohere CEO Aidan Gomez 引用 Sam Altman 关于认同 Dario 前沿限速、承诺接受独立评估机构的推文,并以讽刺口吻逐条批评:要求对手开放员工级访问、以安全为由关停不够安全的竞争者,以及中国不遵守就断供芯片。作者称这些想法是卡特尔式的做法。

    引用Sam Altman@sama

    I agree with Dario that we need to pace the frontier. This has been a primary topic of discussions we've had at OpenAI in recent weeks. Committing to having independent evaluators with employee-like access is a great idea, and we will do the same. We'll have more to share soon.

  3. Jakub Pachocki71

    OpenAI 首席科学家 Jakub Pachocki 以一个爱心符号转发了 Dario Amodei 的新文章《We Must Pace the Frontier》,后者主张 AI 行业应放慢速度,并提出三部分计划,Anthropic 单方面承诺其中第一步,向第三方评估者提供永久、员工级别的系统访问权限,用于验证安全措施执行、报告事故并评估模型训练期间的对齐情况。全文见 https://darioamodei.com/post/we-must-pace-the-frontier。

    引用Dario Amodei@DarioAmodei

    We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so. Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training. You can read the full post here: https://darioamodei.com/post/we-must-pace-the-frontier

9月12日周六
  1. Thinking Machines42

    我们自己的 @johnschulman2 与 Dwarkesh 对话,讨论随着模型不断进步和自我改进,人类判断力在哪些方面仍然重要:教它们处理混乱的现实世界任务,用品味判断什么在长期内有效,以及最重要的——明确我们真正想要什么。

    引用Dwarkesh Patel@dwarkesh_sp

    New episode with @johnschulman2, @oneill_c and @BerenMillidge. I got together with some of the most insightful AI researchers I know who are at the openish companies, because I wanted to hear the details of what's actually happening at the frontier and what comes next. 0:00:00 – Steelmanning the case against RSI 0:18:39 – What’s driving the Chinese labs’ progress 0:28:06 – How will automated AI researchers be trained 0:33:51 – Will long-horizon RL elicit AGI? 0:45:24 – The sim-to-real gap 1:00:33 – How much progress is explained by data? 1:18:03 – Why is RL working so well? 1:24:54 – Move 37 and entropy collapse 1:28:31 – Rapid-fire timelines

  2. Peter McCrory37

    这是该模型的一个重要局限。我们聚焦于 AI 转型的供给侧(AI 能做什么、扩散多快、工人转岗多快)。 价格是灵活的,总需求等于经济体的产出能力。 更多思考见 🧵

    引用modest proposal@modestproposal1

    Anthropic's economic scenario analysis is interesting. But this is not something you can ignore, this is the most important consideration! "the model cannot generate the negative feedback in which disruption depresses demand and amplifies its own labor-market consequences"

  3. Dwarkesh Patel:Podcast & Blog(RSS)61

    Dwarkesh 对谈 John Schulman、Beren Millidge 与 Charlie O'Neill:AI 研究者激辩递归自我改进还有多远

    Dwarkesh Patel 邀请 Zyphra CTO Beren Millidge、Thinking Machines 首席科学家 John Schulman 和 Baseten 模型训练负责人 Charlie O'Neill 对谈递归自我改进(RSI)何时到来。

    推荐理由:三位一线研究者围绕递归自我改进给出了各自不同的技术瓶颈判断,涵盖蒸馏、sim-to-real 与持续学习等具体分歧。

9月11日周五
  1. Newcomer 新闻长文(RSS)40

    面对 AI 安全风波,初创公司更担心网络安全而非生存风险

    OpenAI 与 Anthropic 正把网络安全防御做成新的营收业务线,因为前沿模型在发现和修补系统漏洞上表现突出。Anthropic 上周四发布威胁情报报告,披露恶意行为者试图利用 Claude 从事非法活动;Modal 联合创始人 Erik Bernhardsson 称其公司已用这些模型部分替代昂贵的外部安全顾问。

  2. a16z:News(RSS)43

    a16z:LP 为何错过 SpaceX、Anthropic 与 OpenAI 这一波 AI 浪潮

    a16z 指出,许多 LP 对 SpaceX、Anthropic 和 OpenAI 三家前沿模型公司几乎零敞口,而 SpaceX 上市后市值约 2 万亿美元,成为规模达此前纪录 10 倍的史上最大 VC 背景 IPO,Anthropic 估值 965B 美元、OpenAI 最近估值 852B 美元。作者认为,传统把风投控制在整体组合 5-10% 的资产配置框架已经破裂,LP 需要重新调整风投仓位。

  3. a16z:News(RSS)32

    a16z:雇主开始寻找新型健康保险计划,AI 正在降低建计划门槛

    a16z 发文指出,随着保费每年上涨 10% 以上,多数雇主正开始寻找替代方案,或转向低成本健康计划,或彻底放弃传统健康保险。这一规模达 1 万亿美元、覆盖 1.5 亿以上美国人的雇主医保市场,正因 AI 降低建计划与运营的固定成本门槛而出现代际替换机会,催生一批新型替代健康计划(AHP)、挑战者 PBM 和现代化基础设施平台。

9月10日周四
  1. Peter McCrory52

    Anthropic 首席经济学家 Peter McCrory 与 Jack Clark 对谈其 AI 经济影响情景研究。他表示目标不是做预测,而是理解可能结果的区间及其出现的条件,希望厘清对不确定未来的分歧来源;引用内容提到研究情景从影响很小到 2030 年 GDP 增长 15%、知识工作者失业率达 18%。

    引用John Burn-Murdoch@jburnmurdoch

    New from us: Anthropic just published scenarios for AI’s possible economic impacts, which range from minimal, to explosive GDP growth of 15% by 2030 as knowledge-worker unemployment hits 18%. I sat down with their co-founder Jack Clark to pick his brains on how they’re thinking about all of this.

  2. jietang26

    你确定吗?找到最优模型规模很棘手:数据量、激活参数量、环境数量,以及目标推理成本。模型性能还取决于许多其他因素,每个因素都带来各自的变数。

    引用Charlie O'Neill@oneill_c

    Fable is probably ~2-2.5T parameters, not 10T. Kimi K3 is 2.8T params, trained on maybe 20–30k Blackwell-equivalents. It lands within spitting distance of Fable 5 in terms of capabilities (5, not 5.1). Anthropic has far more compute than Moonshot, better rl environments, better architecture and better optimizers and all of that adds to capability per parameter. So if Fable is only slightly ahead of K3 with this in mind, it's almost certainly a smaller model. GPT-5.5 and 5.6 are smaller still (I'll say more on that later)

  3. elsewhere:文章(RSS)28

    云启圆桌:破壳机器人、昆腾动力、费莫一科技谈具身智能的世界模型与 Scaling

    破壳机器人许华哲、昆腾动力李强、费莫一科技(PHYMI)刘念邱在云启资本与无限基金 SEE Fund 主办的圆桌中,围绕具身智能的世界模型、Scaling 与落地展开讨论。他们认为 Scaling 不只是堆参数和数据小时数,数据多样性、质量分级与多模态信息可能更重要,落地应看节拍、成功率、人工接管率和单位任务的经济价值。

  4. Peter McCrory47

    很好,与我们今天分享的内容互为补充。 评估决定 AI 在未来数年对增长影响大小的关键经济力量(并判断我们如今可能处于哪条路径上)是至关重要的工作。 干得漂亮 @alexolegimas @ben_moll

    引用Alex Imas@alexolegimas

    New post on the blog, featuring the excellent @ben_moll There’s been tons of discourse on how AI will contribute to economic growth, with many people closest to the technology predicting double digit increases. Are these forecasts likely? Probably not. The blog goes through the economics for why exploding improvements in capabilities (which technologists have been largely right about) may not translate to explosive growth. Ben’s thread covers this in detail, but gist is that: 1) there is nothing in economic growth models that prevents AI from leading to explosive growth but 2) this trajectory relies on a series of assumptions that are unlikely to hold in the real world. For example, one assumptions is likely to be violated because of a pretty counterintuitive feature of structural change: the sectors that become automated become smaller parts of the economy (because they’re cheaper, people become richer, and spending moves to non-automated parts of the economy). This, plus other features of the economy, is what will likely cause the trend of huge increases in capabilities coupled with “only” 4-5% growth (which is huge, btw) to continue. Here is the link: https://aleximas.substack.com/p/will-ai-soon-lead-to-double-digit Looking forward to hearing thoughts/feedback!

9月9日周三