跳到正文
原文
arXiv:cs.LG(机器学习,全量分类)· Athanasios Angelakis, Marta Gomez-Barrero·· 15 小时前AI 评分35

hZACH-ViT 曲率对抗攻击研究:规范对称性、边界饱和与对抗失效

Curvature Under Attack in hZACH-ViT: Gauge Symmetry, Boundary Saturation, and Adversarial Failure

AI 导读

研究在 hZACH-ViT 紧凑 Vision Transformer 上考察曲率与对抗鲁棒性的关系,该模型含欧几里得、Poincare 和球面原型头,在三个 MedMNIST 数据集和五个种子上匹配训练。

正文

View PDF HTML (experimental)

Abstract:Curvature is often treated as an intrinsic property of a representation, although its empirical effect also depends on coordinate scale, learned logit temperature, and numerical safeguards. We study this interaction in hZACH-ViT, a compact Vision Transformer with Euclidean, Poincare, and spherical prototype heads. The backbone architecture, seed-specific initialization, 50-per-class training subset, and optimization protocol are matched across three MedMNIST datasets and five seeds. At the fixed comparison curvature $c=1$, Poincare has the lowest class-macro PGD attack-success rate in all 12 dataset-budget cells and under a stronger CE+DLR multi-restart attack on all three datasets, but it also has the lowest clean MacroF1. An end-to-end curvature intervention changes the interpretation. Reducing Poincare curvature to $c=0.1$ improves clean MacroF1 in every one of the 15 paired seed-dataset comparisons and removes hard boundary clipping, yet on OrganAMNIST it increases strong attack success from $89.7\%$ to $99.3\%$ (paired difference $+9.57$ points; 95\% hierarchical bootstrap CI $[+5.52,+14.03]$). At $c=1$, $40$-$47\%$ of clean Poincare features are hard-clipped, the radial Jacobian of the inherited map is nearly zero, and dimensionless attack trajectories are unusually long and inefficient. The spherical head provides a control: its curvature change is an exact scale gauge to floating-point precision and produces much smaller attack differences. These results do not establish intrinsic hyperbolic robustness. They identify an implementation-sensitive regime in which curvature, scale, and proximity to the Poincare boundary jointly organize clean recognition and adversarial representation motion.
Comments: 12 pages, 3 figures, 4 tables. Accepted at NeurReps 2026: Symmetry and Geometry in Neural Representations, NeurIPS 2026
Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2610.00680 [cs.LG]
  (or arXiv:2610.00680v1 [cs.LG] for this version)
  https://doi.org/10.48550/arXiv.2610.00680

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Athanasios Angelakis [view email]
[v1] Wed, 30 Sep 2026 20:20:13 UTC (79 KB)

来源:arXiv:cs.LG(机器学习,全量分类) · arxiv.org