arXiv:cs.LG(机器学习,全量分类)· Xuan Zhong Feng, Geoffrey Martin, Hexin Dong, Yifan Peng·· 13 小时前AI 评分33
基于多任务 QLoRA 的可解释社交媒体自杀风险评估
Explainable Suicide Risk Assessment on Social Media with Multi-Task QLoRA
AI 导读
研究团队提出基于 Qwen2.5-Instruct 与 QLoRA 的多任务系统,用于 IEEE BigData 2026 Cup 可解释自杀风险评估,覆盖风险等级分类、证据短语抽取和多标签因素识别三项任务。
正文
Abstract:Explainable suicide-risk assessment requires models not only to estimate risk severity, but also to identify supporting language and the risk and protective factors expressed in a post. We present our system for the IEEE BigData 2026 Cup on Explainable Suicide Risk Assessment on Social Media, which addresses three tasks: risk-level classification, evidence phrase extraction, and multi-label factor identification. Our approach adapts Qwen2.5-Instruct models using quantized low-rank adaptation (QLoRA) and an answer-masked causal language-model objective. We jointly train across all three tasks for risk classification, jointly train on Tasks~1a and 1b for evidence extraction, and adapt Task~2 separately for factor identification. We also tailor aggregation to each output: we average risk-level probabilities from the 32B and 72B models, combine evidence phrases through cross-fold consensus, and calibrate factor-specific decisions through rate matching based on out-of-fold operating points. On the official leaderboard, the final system achieved a composite score of 0.7738, with 0.8089 on Task~1 and 0.6919 on Task~2. Across the evaluated configurations, three-task training performed best for Task~1a, joint training on Tasks~1a and 1b performed best for Task~1b, and task-specific training performed best for Task~2. Probability averaging further improved Task~1a when component models had complementary errors. These findings highlight the value of tailoring both training objectives and aggregation strategies to the output structure of each task within a unified language-model framework.
| Comments: | Accepted at IEEE BigData 2026 |
| Subjects: | Computation and Language (cs.CL); Machine Learning (cs.LG) |
| Cite as: | arXiv:2610.00610 [cs.CL] |
| (or arXiv:2610.00610v1 [cs.CL] for this version) | |
| https://doi.org/10.48550/arXiv.2610.00610 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Xuan Zhong Feng [view email]
[v1]
Wed, 30 Sep 2026 19:13:19 UTC (80 KB)
来源:arXiv:cs.LG(机器学习,全量分类) · arxiv.org