NVIDIA AI· @NVIDIAAI · X·· 4 小时前同新闻AI 评分79
AI 导读
Meta 发布开源权重模型 Muse Spark Open,总参数 816B、激活 42B(MoE),在 Artificial Analysis Intelligence Index 得 39 分,为美国开源权重模型中最高。该模型 token 用量较少,每任务成本 $0.84,支持文本、图像、视频、音频输入,1M token 上下文窗口,BF16 权重约 1.6TB,NVFP4 量化后约 530GB,可在四张 Blackwell Ultra GPU、八张 H200 或两台 512GB M5 Ultra Mac Studio 上自托管,权重已上 Hugging Face。其相对短板是智能体评测,在九个高分开源权重模型中的四项智能体评估上排名末位;采用 Muse Model License,要求标注归属,年营收超 $20M 的模型服务商家需与 Meta 另行签约。
同一新闻,精选展示《Meta 发布开源权重多模态 MoE 模型 Muse Spark Open:816B 参数、1M 上下文》
正文 · 原文
Congrats @alexandr_wang and @Muse team on releasing such an epic open weights model!
Meta has released Muse Spark Open, an 816B (42B active) open-weights model that scores 39 on the Artificial Analysis Intelligence Index, making it the #1 US open-weights model Muse Spark Open (xhigh) scores 22 points above Muse Glimmer (high, 17), Meta's 30B dense open-weights model from August. It is also ahead of NVIDIA's Nemotron 3.5 Super VL (26), the next highest-scoring US open-weights model, which launched today @AIatMeta shared access with us ahead of public release for benchmarking. Congratulations to @AIatMeta, @finkd, and @alexandr_wang on the release! Key Takeaways: ➤ Open weights at the level of Meta's August flagship. Muse Spark Open scores within a point of Muse Spark 1.2 (xhigh, 40). It is stronger on AutomationBench-AA and has a lower hallucination rate, but weaker on GDPval-AA v2.1, CritPt and AA-Omniscience accuracy. Within Meta's current lineup, it sits 13 points behind Muse Wonder (max, 52) and 17 points behind Muse Wonder Full (max, 56) ➤ Token-efficient, at a moderate cost per task. Muse Spark Open uses 40k output tokens per Intelligence Index task, the fewest among the nine highest-scoring open-weights models: e.g. 16% fewer than Muse Spark 1.2 (xhigh, 48k) and 43% fewer than GLM-5.3 (max, 71k), its closest Chinese peer by size. Together AI, Fireworks and Baseten offer it at launch for $1.25/$4.25 per 1M input/output tokens ($0.15 cached input). At that pricing it costs $0.84 per Intelligence Index task. That is less than Muse Spark 1.2 ($0.97) at the same per-token prices and less than half of GLM-5.3 (max, $2.01), but about three times DeepSeek V4.1 Flash (max, $0.27) ➤ A relative weakness in agentic work compared to Chinese open-weights leaders. Among the nine highest-scoring open-weights models, Muse Spark Open ranks last on the four agentic evaluations in the index but fourth on the other six combined, and it leads all open-weights models on AA-Omniscience (25). GLM-5.3 (max), the closest Chinese model by size, owes all of its 6-point lead to the agentic evaluations ➤ Self-hostable on a single node, or two Mac Studios. BF16 weights are ~1.6TB. Meta's NVFP4 checkpoint quantizes only the 256 experts, cutting the weights to ~530GB. Meta says this runs on four Blackwell Ultra GPUs or eight H200s, or on two 512GB M5 Ultra Mac Studios using MLX. The architecture uses 62 layers with grouped-query attention (16 KV heads), 8 of 256 experts active per token, and a 1.8B-parameter Perception Encoder for vision Other model details: ➤ Parameters: 816B total, 42B active (MoE) ➤ Context window: 1M tokens ➤ License: Muse Model License, a custom license that requires "Built with Muse Spark Open" attribution and a separate agreement with Meta for Model-as-a-Service businesses with over $20M in annual revenue ➤ Input modalities: text, image, video and audio. Output: text ➤ Availability: weights on Hugging Face (BF16 and NVFP4), with API access via Baseten, Fireworks AI, Groq, Modal, Nebius, OpenRouter and Together AI在 X 查看被引用的帖子
来源:NVIDIA AI · x.com