跳到正文
arXiv:cs.LG· Yu Yan·· 4 小时前

JevForest:预算受限特征获取中的路径投票方法

JevForest: Path Voting for Budgeted Feature Acquisition

AI 导读

JevForest 通过聚合自助采样树的路径提议并按全局训练信息增益加权,用共享掩码分类器从已获取特征进行预测,实现在有限观测预算下选择信息。在 AG News 小样本上四问森林获取准确率 0.729,高于静态增益排序的 0.667 和随机排序的 0.583;在 TREC 上顺序反转,森林为 0.667,低于 0.750 和 0.833。

正文

View PDF HTML (experimental)

Abstract:Choosing which information to observe is central to prediction under limited observation budgets. We study JevForest, a feature acquisition policy that aggregates path-dependent proposals from bootstrapped trees, weights them by global training information gain, and predicts from the acquired values with a shared masked classifier. An online implementation queries Jev for semantic answers selected by this policy. On small balanced held-out samples, four-question forest acquisition achieves accuracy $0.729$ on AG News ($n=48$), compared with $0.667$ for a static gain ranking and $0.583$ for random ordering. On TREC ($n=24$), the ordering reverses: forest accuracy is $0.667$, compared with $0.750$ and $0.833$. Asking all eight questions in one batch yields higher accuracy at lower measured cost and latency than four sequential forest queries; direct Jev classification matches the batch accuracy while costing less. Offline MiniBooNE experiments yield accuracy $0.845\pm0.010$ at ten features and $0.885\pm0.008$ at forty features over three jointly varying data and forest seeds (mean $\pm$ sample standard deviation). A companion Newton boosting implementation provides preliminary full-feature synthetic results. These exploratory findings establish a working Jev acquisition workflow but do not support a general advantage for path voting: its value depends on the task, predictor, and the distinction between question budgets and actual query costs.
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Cite as: arXiv:2610.10615 [stat.ML]
  (or arXiv:2610.10615v1 [stat.ML] for this version)
  https://doi.org/10.48550/arXiv.2610.10615

arXiv-issued DOI via DataCite

Submission history

From: Yu Yan [view email]
[v1] Wed, 7 Oct 2026 07:23:47 UTC (17 KB)

来源:arXiv:cs.LG · arxiv.org