arXiv:cs.AI· Istok Bako, Bonan Min, Tiffany Shao, Claire Cheng, Yashar Mehdad·· 16 小时前
用可移植技能实现极简智能体 RAG:客服场景部署案例
Frustratingly Easy Agentic RAG via Portable Skills: A Case Study in Customer Support
AI 导读
一个由自然语言指令、轻量工具和 LLM 生成的“Wikipedia 式”导航索引组成的可移植技能,在客服解决流程生成任务上达到 99.2% 流程等价率和 83.3% 证据充分率,1-2 个工程师日即可实现并可在 Claude Code 等智能体框架间迁移。该方法每案例约 90 秒,比已部署生产助手(约 8-9 秒)慢约一个数量级。
正文
Abstract:Enterprise workflow automation typically requires retrieving a complete and accurate set of relevant information from large operational document corpora (SOPs, policy documents) given a specific scenario or request. In customer support (CS), for example, human specialists must determine the correct sequence of resolution steps for each case, a task that demands precise grounding in policy documentation. Meeting this bar in production typically requires complex document chunking, indexing, and retrieval pipelines, often layered with learned re-rankers, query rewriters, and bespoke agentic RAG infrastructure.
We report a deployment case study of a simpler alternative: a portable skill consisting of a natural-language instruction, lightweight tools (a retrieval API, format-checking scripts), and a corpus enriched with an LLM-generated navigation layer, which is a structured "Wikipedia-style" index over the underlying documents. This agentic RAG approach is straightforward to implement (1-2 engineer days), portable across capable agentic harnesses (e.g., Claude Code), and performs strongly on the challenging task of CS resolution workflow generation, achieving 99.2% procedural equivalence to human-approved ground truth and 83.3% evidence sufficiency. It is also roughly an order of magnitude slower per case than our deployed production assistant (~90 s vs. ~8-9 s), so we claim no latency advantage. Our claim is scoped to that setting: a mature, well-curated corpus, a latency-tolerant workflow, and human review of every case. There, the skill did the work of a complex RAG stack, and maintenance became a matter of editing text and data rather than retraining models.
| Comments: | Accepted to EMNLP 2026 Industry Track. 15 pages, 1 figure, 5 tables |
| Subjects: | Artificial Intelligence (cs.AI) |
| Cite as: | arXiv:2610.14428 [cs.AI] |
| (or arXiv:2610.14428v1 [cs.AI] for this version) | |
| https://doi.org/10.48550/arXiv.2610.14428 arXiv-issued DOI via DataCite (pending registration) |
Submission history
From: Istok Bako [view email]
[v1]
Sat, 10 Oct 2026 00:49:01 UTC (29 KB)
来源:arXiv:cs.AI · arxiv.org