Skip to content

AI Market · Forecast desk · Live · software

32%

A frontier lab publishes turn count or task-completion cost as a headline metric alongside benchmark scores in an official model card or launch post by January 31, 2027.

Probability history

0%25%50%75%100%08-15deadline

Called at 26% on August 15, 2026. Not yet repriced. 104 days to deadline.

How the number was built

Final method: stacked-fixed-weights (resolved n=74 < 80). Each rung is an independent estimate; the final is a stacked combination.

Stated (issue date)26%
Reference class (n=10)50%
Recalibrated45%
Feature model22%
Council29%
Final32%

Drivers

  • Reference class qtype:timing runs 0.50 (n=10) vs stated 0.26.
  • Hierarchical calibration moves stated 0.26 to 0.45 (lens software, kappa_stated=80.0, kappa_lens=200.0).
  • Feature model at 0.22: conjuncts=1, named disclosure=False, horizon=169d.
  • Council of 5 at 0.29.

Cautions

  • all 5 votes came from one vendor (openai); extremization disabled, persona diversity only

Council

5 personas on one model (openai/gpt-5.6-sol); other vendors were unavailable this run, so read this as one model's persona-averaged view, aggregated by log odds mean without extremization.

31%

grid and power economist · openai/gpt-5.6-sol

Frequent 2026 model releases imply several opportunities before January 31, and agentic evaluations make turns and dollar cost increasingly decision-relevant. However, the rule is document-specific: a model card must elevate one of these measures to a headline field. Frontier cards more commonly headline benchmark accuracy, context length, latency, or token efficiency; turn counts and task-cost assumptions often remain in methodology or appendices. Only 104 days remain, including a holiday-heavy window, and ambiguity counts as failure. This is modestly above the forecaster’s 0.26 but below broad software and timing base rates because the required publication format is unusually narrow.

33%

semiconductor supply chain analyst · openai/gpt-5.6-sol

Several frontier labs are likely to publish model cards within 104 days, and agentic evaluations increasingly make efficiency salient. However, model cards still usually headline success rates, benchmark scores, latency, or token usage rather than turn count or end-to-end task-completion cost. Cost is also deployment- and harness-dependent, discouraging its treatment as a stable model metric. The strict requirement that it appear as a headline field—not supporting text or a footnote—substantially lowers the hit rate. The supplied release cadence shows continued model activity but no direct evidence that this reporting convention has already emerged.

24%

capital markets credit analyst · openai/gpt-5.6-sol

Frontier labs are likely to release at least one major model within 104 days, and agent evaluations increasingly expose efficiency differences. However, model cards usually headline success rates, benchmark scores, safety results, context length, or latency—not turn count or dollar/token cost per completed task. Cost is especially awkward because it depends on pricing, scaffolding, and evaluation settings; turn count is often relegated to methodology. The strict requirement that either metric be a headline field, combined with ambiguity resolving against the forecast, materially lowers the probability despite growing interest in agent efficiency.

24%

superforecaster statistician · openai/gpt-5.6-sol

I use the >90-day base rate of 0.404, cross-checked against the software rate of 0.446. Multiple active frontier labs and frequent model releases create several opportunities before the deadline. However, the rule requires a model card—not merely a paper, benchmark page, or announcement—and the metric must be a headline field. Turn count and task-completion cost remain less standard than accuracy, latency, or token usage. The hard disclosure deadline and ambiguity-against policy substantially reduce the chance. The forecaster’s low-confidence calibration sample is too small to justify raising its 0.26 estimate.

34%

geopolitics regulation analyst · openai/gpt-5.6-sol

Agentic evaluations increasingly make interaction count and end-to-end cost decision-relevant, and several active frontier labs could release models within 104 days. That creates multiple opportunities for adoption. However, model cards still emphasize accuracy, latency, context length, token pricing, and benchmark scores; turn count is commonly buried in evaluation methodology, while token price is not necessarily task-completion cost. The rule’s model-card and headline-field requirements exclude qualifying metrics appearing only in papers, launch posts, benchmark dashboards, or footnotes. These strict documentation conditions justify a forecast below the software and timing reference-class rates.

Evidence the engine used

direct · undated

Models – Hugging Face

Cited by grid-and-power-economist: Frequent 2026 model releases imply several opportunities before January 31, and agentic evaluations make turns and dollar cost increasingly decision-relevant. However, the rule is document-specific: a model card must elevate one of these measures to a headline fiel