Artificial Analysis 推出 Search Index,在 1700 个任务上用同一基座模型和测试框架,通过 BrowseComp、DeepSearchQA 和 AA-Omniscience 三个基准衡量各 Search API 的性能、成本和延迟。
Search is one of the most important tools for agents, and they search very differently to humans. By the end of the year, agents are expected to search the web far more than humans do
The Artificial Analysis Search Index measures the performance, cost and latency of Search APIs across 1700 tasks and three search-specific benchmarks: BrowseComp, DeepSearchQA and AA-Omniscience using the same base model and harness.
Developers can use the Artificial Analysis Search Index to inform their choices when it comes to what search tool their agent should be using. Now you can see who’s #1 while waiting for the bus. Currently Exa (auto) and Perplexity (medium) lead in performances with their best models scoring 80.
来源:Artificial Analysis · x.com