arXiv：cs.AI· Jungseob Lee, Seongtae Hong, Dongyub Jude Lee, Chanjun Park, Jaehyung Seo, Sugyeong Eo, Heuiseok Lim·· 10 小时前AI 评分47
GLANCE：面向视觉语言模型无损推测解码的一次性块草拟方案
Vision Is Not Overhead: One-Pass Block Drafting for Lossless Speculative Decoding in Vision-Language Models
AI 导读
GLANCE 是一种一次性块草拟器，通过块扩散头在目标模型已融合的视觉-语言状态上单次前向草拟整个块，让草拟器完整读取多模态上下文。在固定轮次预算的生产引擎中，其解码速度最高达自回归解码的 3.05 倍，在 grounded 任务上平均超过生产版 EAGLE3-VL 头约 11%。熵定律可解释草拟何时见效，并预测 grounded 任务中接受块最长。代码已公开。
正文
Abstract:Speculative decoding accelerates generation without changing its output, but on vision-language models (VLMs) a self-reinforcing cycle holds it back. Because an autoregressive drafter pays a sequential pass for each drafted token, it must stay small and can ill afford to attend to the image at each pass. Prior work therefore compresses or hides the image, leaving the drafter weakest on the text the image determines. We present GLANCE, a one-pass block drafter that breaks this cycle on an unmodified VLM target. Its block-diffusion head drafts a whole block in one forward pass over the target's already fused vision-language states, reading the multimodal context once, however deep the draft. The target verifies a wide candidate tree in one pass and commits exactly its greedy output. In one production engine at a fixed round budget, GLANCE decodes up to 3.05 times faster than autoregressive decoding and outpaces the production EAGLE3-VL head on average and by about 11% on grounded tasks. An entropy law explains when drafting pays, predicting the longest accepted blocks on grounded tasks, where the target's next-token entropy is lowest. Our code is available at this https URL.
| Comments: | 21 pages, 8 figures, 16 tables. Code: this https URL |
| Subjects: | Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV) |
| Cite as: | arXiv:2609.00355 [cs.AI] |
| (or arXiv:2609.00355v3 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2609.00355 arXiv-issued DOI via DataCite |
Submission history
From: Jungseob Lee [view email]
[v1]
Mon, 31 Aug 2026 20:50:35 UTC (729 KB)
[v2]
Tue, 29 Sep 2026 04:15:09 UTC (610 KB)
[v3]
Tue, 6 Oct 2026 14:49:05 UTC (473 KB)
来源：arXiv：cs.AI · arxiv.org