共享线性映射能走多远？探测图像编辑的特征空间可操控性

View PDF HTML (experimental)

Abstract:Understanding how image-space transformations manifest in a model's internal representations is a longstanding goal in representation analysis. Prior work has shown that geometric transformations can often be captured by learned linear operators between feature maps, but it remains unclear whether this extends to photometric, local, and semantically defined edits. We train probes of increasing capacity from a spatially shared linear map to nonlinear per-vector, receptive-field, and global transformer models to predict feature-space changes induced by geometric transforms, photometric edits, occlusions, and diffusion-generated semantic edits. Across ConvNeXt, SwinV2, and DINOv3, a single shared linear map often predicts held-out manipulation outcomes nearly as well as substantially more expressive probes for the supervised backbones, with sufficiency generally increasing with depth; this pattern is less consistent for DINOv3. These results suggest that a simple spatially shared linear operator is often sufficient to represent diverse image manipulations, while its leading singular components capture semantic content and higher-rank components primarily refine image details. We frame these findings as predictive representational sufficiency rather than evidence of intrinsic linear feature-space geometry.

Comments:	46 pages, 40 figures, 3 tables, Code is available at this https URL
Subjects:	Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Cite as:	arXiv:2605.11203 [cs.LG]
	(or arXiv:2605.11203v2 [cs.LG] for this version)
	https://doi.org/10.48550/arXiv.2605.11203 arXiv-issued DOI via DataCite

Submission history

From: Elias Krey [view email]
[v1] Mon, 11 May 2026 20:12:44 UTC (31,726 KB)
[v2] Fri, 2 Oct 2026 08:56:11 UTC (42,546 KB)