跳到正文
原文
arXiv:cs.LG(机器学习,全量分类)· Shuyang Jiang, Fucheng Deng, Yuchuan Luo, Zhenyu Wu·· 5 小时前AI 评分51

梯度冲突能否预测理解与生成的权衡?统一多模态模型冲突指标有效性的受控审计

Does Gradient Conflict Predict the Understanding--Generation Trade-off? A Controlled Audit of Conflict-Metric Validity in Unified Multimodal Models

AI 导读

arXiv 论文(arXiv:2609.38465)在受控测试床 GRIDUMM 中审计统一多模态模型(UMM)训练中梯度冲突指标对理解-生成权衡的预测有效性。

正文

View PDF HTML (experimental)

Abstract:Unified multimodal models (UMMs) are increasingly designed around gradient conflict between understanding and generation objectives. The premise that reducing these metrics improves the downstream understanding-generation trade-off has never been tested directly. We audit it in a controlled testbed, GRIDUMM, which mirrors key structural ingredients of UMM training while making the ground-truth trade-off exactly computable. Across 63 configurations and 372 measured checkpoints, no directional conflict metric reaches an absolute Spearman correlation of 0.3 with a confidence interval excluding zero for conflict measured during training against the eventual trade-off. A dose-response intervention that monotonically suppresses conflict leaves the trade-off flat, separating correlation from causation. The norm ratio is a generation-failure detector and becomes null among configurations that master generation. Functional interference measures outperform directional conflict metrics, while training loss tracks the trade-off strongly. Our results do not show that conflict is useless; they show that its validity as a diagnostic target must be established, not assumed, and we release the audit protocol as a reusable standard.
Comments: 23 pages, 10 figures, 5 tables. Code will be made publicly available upon acceptance
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2609.38465 [cs.LG]
  (or arXiv:2609.38465v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2609.38465

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Shuyang Jiang [view email]
[v1] Tue, 29 Sep 2026 19:57:47 UTC (2,589 KB)

来源:arXiv:cs.LG(机器学习,全量分类) · arxiv.org