Skip to content

AI Market · Forecast desk · Live · software

52%

Artificial Analysis publishes Endpoint Accuracy Index results covering at least two models beyond the initial GLM-5.2, gpt-oss-120b and DeepSeek V4 Pro set by October 31, 2026.

Probability history

0%25%50%75%100%08-08deadline

Called at 83% on August 8, 2026. Not yet repriced. 12 days to deadline.

How the number was built

Final method: stacked-fixed-weights (resolved n=74 < 80). Each rung is an independent estimate; the final is a stacked combination.

Stated (issue date)83%
Reference class (n=25)65%
Recalibrated60%
Feature model68%
Council41%
Final52%

Drivers

  • Reference class qtype:threshold runs 0.65 (n=25) vs stated 0.83.
  • Hierarchical calibration moves stated 0.83 to 0.60 (lens software, kappa_stated=80.0, kappa_lens=200.0).
  • Feature model at 0.68: conjuncts=1, named disclosure=False, horizon=84d.
  • Council of 5 at 0.41.

Cautions

  • all 5 votes came from one vendor (openai); extremization disabled, persona diversity only

Council

5 personas on one model (openai/gpt-5.6-sol); other vendors were unavailable this run, so read this as one model's persona-averaged view, aggregated by log odds mean without extremization.

38%

grid and power economist · openai/gpt-5.6-sol

Only 12 days remain, and the supplied digest contains no evidence that Artificial Analysis has published the qualifying Endpoint Accuracy Index expansion. Software releases are active, but that is weak evidence for completion of this specific benchmarking deliverable. The strict rule requires full stated coverage; partial pages miss, and the expansion itself is not reproduced here, increasing resolution risk under the adverse ambiguity policy. Relevant software forecasts have realized near 0.446, while the forecaster’s 0.8–0.9 confidence bin realized 0.6 including partial credit. Thus 0.83 appears materially too high.

42%

semiconductor supply chain analyst · openai/gpt-5.6-sol

Only 12 days remain, and the digest provides no evidence that Artificial Analysis has already published the required full coverage expansion. Software and threshold reference classes are mixed, while the forecaster’s 0.80–0.90 bin has realized only 0.60. Publication could occur quickly, but the literal requirement and partial-page exclusion create meaningful execution and documentation risk. The original 0.83 is therefore too high absent a dated announcement or substantially complete index page.

46%

capital markets credit analyst · openai/gpt-5.6-sol

Only 12 days remain, and the supplied digest contains no direct evidence that Artificial Analysis has published or scheduled the required Endpoint Accuracy Index expansion. The exact expansion is also absent from the question, while resolution requires complete coverage and explicitly counts partial pages as misses. Software and threshold reference classes point to roughly 0.45–0.65, but the hard publication deadline and adverse ambiguity rule pull below the forecaster’s historically overconfident 0.83 band.

36%

superforecaster statistician · openai/gpt-5.6-sol

I use the software-lens base rate of 0.446. The threshold and original-horizon classes are stronger, but this requires a specific publisher’s complete index expansion by a hard deadline, with partial pages explicitly failing. Only 12 days remain, and the digest provides no verifiable evidence that the required coverage is complete or scheduled. More importantly, the prompt does not define the “stated expansion”; under the against-forecaster ambiguity policy, that materially raises resolution risk. The forecaster’s 0.83 also warrants correction: its 0.8–0.9 calibration bin realized only 0.6, before accounting for this question’s stricter publication and completeness requirements.

44%

geopolitics regulation analyst · openai/gpt-5.6-sol

Only 12 days remain, and the supplied digest provides no evidence that the qualifying expanded index has been published or is imminent. Software forecasts in this ledger resolve below half, while the forecaster’s 0.80–0.90 band has realized only 0.60 across five cases. The original threshold and horizon classes are stronger, but publication schedules often slip. Most importantly, the rule requires complete coverage of the stated expansion; partial pages miss and ambiguity resolves against the forecast. This is materially below the forecaster’s 0.83.

Evidence the engine used

direct · undated

AI Model &amp; API Providers Analysis | Artificial Analysis

Cited by grid-and-power-economist: Only 12 days remain, and the supplied digest contains no evidence that Artificial Analysis has published the qualifying Endpoint Accuracy Index expansion. Software releases are active, but that is weak evidence for completion of this specific benchmarking deliverab