NVIDIA Nemotron Labs 发布开源权重推理模型 Dory1.0-4B,支持最高 256K 上下文,采用 OpenMDW License v1.1。
NVIDIA Nemotron Labs Dory1.0-4B is an open-weight reasoning model with up to 256K context, letting developers adjust inference compute within a single checkpoint.
🤖 https://modelscope.ai/models/nv-community/NVIDIA-Nemotron-Labs-Dory1.0-4B-BF16
🔁 One checkpoint, adjustable compute: Run the shared recurrent block for different numbers of loops to balance latency and accuracy per task, with no retraining or model swap.
🏆 Stronger coding-agent results at 4B: At two loops, it reaches 59.5 on SWE-bench Verified in the vendor evaluation, ahead of Qwen3.5-4B at 54.7.
🧠 Extra thinking without longer answers: More loops add latent compute per token instead of simply generating more tokens.
⚡ Loop without compounding cache cost: Optional last-loop KV caching keeps one cache per recurrent attention layer, avoiding extra KV-cache overhead as loop count grows.
📚 Built for long-context workloads: 4B parameters, up to 256K context, and releases in BF16, MXFP8, NVFP4, and Q5_K_M formats.
📜 OpenMDW License Agreement v1.1.
来源:ModelScope · x.com