Artificial Analysis AI Releases: Intelligence Index v5, Optima & Endpoint Accuracy Index

artificialanalysis.ai ↗

ThursdAI — the weekly AI news podcast hosted by Alex Volkov — has covered 4 Artificial Analysis releases since May 2026, most recently Intelligence Index v5 on Oct 29, 2026. Highlights include Endpoint Accuracy Index, Intelligence Index v5, Coding Agent Index, Optima. Every entry below has primary-source links and the episode segment where we covered it live, plus key numbers where we have them.

4 releases4 episodesMay 2026 – Oct 2026

October 2026 1

Artificial Analysis
Benchmarks & Evals

Intelligence Index v5

Artificial Analysis launches Intelligence Index v5 and Progress Index v1

For the first time, more than half of the Intelligence Index score comes from private tasks that labs cannot train on. v5 has four categories at 25% each (knowledge work, coding, general intelligence and science), retires some older evals and adds new ones like Terminal-Bench-Science. The new Progress Index gives every model since November 2022 the same set of questions.

4 x 25% categoriesNov 2022 Progress Index start

August 2026 2

Artificial Analysis
Products & Apps

Optima

Artificial Analysis launches Optima: private evals from your own traces

Artificial Analysis launched Optima, which builds private evaluations from your own use case and agent traces. Co-founder George Cameron discussed it on the show alongside the three-factor model-selection framework of intelligence, speed, and cost per task.

Artificial Analysis
Benchmarks & Evals

Endpoint Accuracy Index

Endpoint Accuracy Index: the same open weights score 52% to 100% depending on your provider

Artificial Analysis launched an index measuring whether inference providers actually serve the model they claim: GLM-5.2 scores 52% on one provider and 100% on three others with a 5.2x price spread, and some gpt-oss-120b endpoints hit 22% on tool calling versus the reference's 37%. Low scorers produce about half the output tokens per task, pointing at aggressive quantization. v1.0 covers GLM-5.2 (15 providers), gpt-oss-120b (20), and DeepSeek V4 Pro (9), with Kimi K3 next. CoreWeave came in cheapest on gpt-oss-120b at $0.04/M blended with 98% accuracy.

52% vs 100% same GLM-5.2 weights across providers5.2x price spread across GLM-5.2 endpoints$0.04/M CoreWeave's gpt-oss-120b blended price at 98% accuracy

May 2026 1

Artificial Analysis
Benchmarks & Evals

Coding Agent Index

Artificial Analysis Coding Agent Index benchmarks model + harness combos

Artificial Analysis launched the Coding Agent Index, a benchmark that evaluates model and harness combinations rather than models alone. Opus 4.7 in Cursor CLI leads at 61, GLM-5.1 tops the open-weight entries at 53, and costs vary 30x across combos for similar capability.