arXiv:cs.CL· Yiping Bai·· 3 小时前AI 评分24
QuanLing 跨语系验证:西罗曼语族语言距离量化
QuanLing: Cross-Branch Validation of Language Distance Quantification on Western Romance
AI 导读
QuanLing 框架从北日耳曼语族扩展至西罗曼语族(法语、葡萄牙语、西班牙语、意大利语),验证其跨语系适用性。基于 150 组四语平行句,LaBSE 句嵌入显示葡萄牙语—西班牙语距离最近(0.0229),法语—意大利语最远(0.0338),LaBSE 与 mBERT 在 6 组语言对中 4 组排序一致。
正文
Abstract:Quantifying language distance among closely related languages remains a core challenge in quantitative linguistics. Our previous work [1] introduced QuanLing (Quantitative Linguistics via Pretrained Language Models), a quantitative framework combining language distance metrics (sentence embedding distance, tokenization fragmentation rate) with language property analysis (MLM prediction probability), validated on North Germanic (Danish, Norwegian Bokmål, Swedish). This paper extends QuanLing to Western Romance--French, Portuguese, Spanish, Italian--testing cross-branch applicability with the same metric family and aggregation protocol as our North Germanic study, adapted for four languages (English anchor, quadruplet construction). Using 150 four-language parallel sentences, we compute LaBSE sentence embedding distances, tokenization fragmentation rates from four monolingual BERT tokenizers, and mBERT masked language model mutual intelligibility. Results show that Portuguese--Spanish are closest (LaBSE distance 0.0229), French--Italian most distant (0.0338); LaBSE and mBERT rankings agree on 4 of 6 pairs, confirming cross-model robustness. Western Romance shows a wider absolute distance span than North Germanic (0.011 vs. 0.008) but comparable relative ratios (1.48 vs. 1.67), consistent with longer divergence time. French exhibits notably higher MLM predictability (36.12% top-1 accuracy vs. 29.28% for Italian), reflecting its orthography--phonology decoupling. This cross-branch validation provides further evidence for QuanLing's generalizability beyond a single language branch.
| Subjects: | Computation and Language (cs.CL); Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.08851 [cs.CL] |
| (or arXiv:2610.08851v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.08851 arXiv-issued DOI via DataCite |
Submission history
From: Yiping Bai [view email]
[v1]
Sat, 3 Oct 2026 03:11:29 UTC (526 KB)
来源:arXiv:cs.CL · arxiv.org