跳到正文
Tomer Tunguz 博客·· 2025-02-19AI 评分23

AI 性能的"肘点":推理能力对商业意味着什么

The AI Elbow's Impact : What Reasoning Means for Business

AI 导读

2024 年 10 月成为 AI 发展的关键拐点,性能数据中出现一个"肘点",此后 AI 性能从线性增长转为几何级增长。推动这一变化的已不是模型规模,而是推理——让模型阐述思考过程、权衡备选方案并最终选择其一,从而实现更高准确率、更少错误,以及持续十五分钟以上的深度研究。

正文 · 原文

In short : AI reached a pivotal moment in 2023, enhancing performance through advanced reasoning and deep research capabilities.

October 2024 marked a critical inflection point in AI development. Hidden in the performance data, a subtle elbow emerged - a mathematical harbinger that would prove prophetic.

What began as a minor statistical anomaly has since exploded into exponential growth.

Since then AI performance has surged attaining a new trajectory, a new slope - no longer linear but geometric.

image

Segmenting out the models by size and type, the source of the innovation is clear. No longer model size which drove the initial wave of improvements, nor the improvements in the smaller models of the early fall.

It’s reasoning - ask a model to articulate its thought process, consider alternatives, & ultimatey select one.

image With improved accuracy, fewer errors, & the ability to conduct deep research - work extending for fifteen minutes or more, the potential of the technology has never felt more tangible.

Recently, Alberto Romero suggested that the differences between the performance of AI models is much less important than the difference between people’s ability to use them well. A sophisticated user of AI - like any skilled worker - can produce much more than a novice.

As these models continue to improve, it may be less important for management teams to track relative benchmarks of AI performance & much more to train their teams & reimagine their workflows.

Get the next one in your inbox

The 1-minute read that turns tech data into strategic advantage.
Read by 150k+ founders & operators.

GP at Theory Ventures. Former Google PM. Sharing data-driven insights on AI, web3, & venture capital.

Bloomberg • WSJ • Economist

来源:Tomer Tunguz 博客 · tomtunguz.com