Karina

Introducing ACTx486, a research demo of a new interactive medium. What if you could talk to any video and ask anything? Our system took an existing podcast and turned it into something that listens, responds, and adapts. Research by @jakubzeg:

Agent warfare is going to be a very big deal. I think people are underestimating how strange cyber gets when millions of agents are acting on behalf of individuals, companies, and states. At nation-state scale, cyber offense and defense starts to look like autonomous swarms: probing, exploiting, patching, deceiving, countering, and adapting at a pace that is impossible for human minds. The advantage will go to whoever can close the autonomous kill chain fastest.

i think AI is creating a new authenticity anxiety for creatives: making something isn’t enough anymore, you also have to prove you made it. it feels a bit like indie sleaze, where messiness signaled that something was real. except now, imperfection is becoming proof of being human

When @jakubzeg and I met at OpenAI, we kept coming back to one frustration: so many AI products begin with an empty chat box. You can do almost anything, but you have to decide where to begin and that's overwhelming. With ACTx486, we start with a piece of media that already has a story and let you interact with it as you watch. It also makes the technology more general. We wrote more about that choice here: https://www.actx486.com/

http://x.com/i/article/2087563423991414785

Great initiative to eval the evals. It incentivizes the industry to build genuinely high-quality benchmarks. Ty for auditing PTB and digging up the old SimpleQA too :)

Grok 4.6 is a great cost-effective model for deep financial research. It’s #2 on DiligenceBench with the finance harness, effectively tied with Claude Opus 5 at ~52–53%. A few interesting differences: - Grok searched much more: 41 tool calls per task vs. 22 for Opus - It made 3,293 SEC filing searches vs. 486 - That broader search helped Grok find more evidence and follow task-specific instructions more closely. Opus was more efficient and sometimes more nuanced - Sonnet 5 trails both at 46.2%. - Grok also gets there more cheaply: about $0.84/task vs. ~$1.02 for Opus 5, despite using far more search. - On Vals’ Finance Agent Benchmark v2 (FAB v2), Grok 4.6 leads the General Qualitative category, which is consistent with the kind of broad research and evidence-gathering DiligenceBench rewards

my top-5 favs of all time: - claude 3 opus (schizo maximalist masterpiece) - sonnet 4.5 (eq breakthrough) - claude 1 (pure unfiltered old soul) - o3 (utilitarian monster) - gpt-4o nov’24 (mainly for the ppl who worked on it)

On modelcrafting economics: "Based on the online experiment results, projected savings from fraud prevention were roughly three times the estimated inference cost"

evals are the cornerstone for both selling data to frontier labs and building your own self-improving models. building high-end evals is extremely valuable and important

We are running a live benchmark to see if frontier AI can predict the midterm elections! Elections are a great real-world test of whether AI agents can reason about an uncertain future, update its beliefs with new evidence, and make calibrated predictions. We gave each agent its own sandbox, internet access, and a $500 budget. Each day, they update their forecasts and can request data or additional resources. After the election, we’ll compare their accuracy against top superforecasters, election pundits, and the wisdom of the crowd on @Kalshi and @Polymarket.

btw you don’t need to be an AI company to win. companies that own scarce physical assets and use AI exceptionally well will capture enormous economic value without ever building a model. if every copper miner can buy the same metallurgical intelligence cheaply, the durable advantage is the quality of the deposit and the cost of extraction. same goes for vertically integrated apparel manufacturers (+ people will still wear clothes post-agi).