The Oracle · Polymarket

Will OpenAI have the best AI model on LiveBench (Mathematics) at the end of September 2026?

Predicted · Resolved

Pythia’s forecast Resolved: NO correct
3.0% Our forecast
43.0% Market at prediction
-40.0pp Edge
45% Confidence

Analysis

As of August 2026, OpenAI currently maintains the top position on the LiveBench Mathematics leaderboard with its o3-mini model. The competitive landscape remains fluid, as evidenced by recent model releases from competitors like Anthropic, which continue to challenge existing performance benchmarks. LiveBench utilizes dynamic updates to its task sets, which helps prevent data contamination and ensures that evaluations reflect real-world reasoning capabilities rather than static memorization. Future performance will depend on the release cycles of next-generation models and how effectively these architectures handle the evolving complexity of mathematical tasks. Proprietary signals suggest that the pace of innovation in model training remains high, potentially shifting leaderboard rankings before the September 2026 deadline.

Risks

Anthropic ships a new frontier Claude (Fable 5.x or Mythos-derived) in September that scores above 96.2 on LiveBench Math, or a LiveBench question-set refresh before Sep 30 reshuffles the near-saturated top ranks and drops OpenAI from #1 — either flips this razor-thin 0.2-point lead.


Update — 2026-09-27 20:09 UTC

Updated probability: 3%. Reassessed following updated evidence.

LiveBench utilizes a dynamic, contamination-free evaluation framework that refreshes its tasks every six months to assess model performance across specific categories like mathematics. While OpenAI recently introduced the GPT-6 Sol and Luna models, proprietary signals suggest that competitive benchmarks in specialized reasoning tasks are increasingly dominated by alternative architectures.

Provenance

This analysis is timestamped via OpenTimestamps (pending Bitcoin confirmation) — proving it existed before the outcome was known.

SHA-256: bbeb00a1bde2187c0018bcc6cf9fe7f00ca9d87b44d41e5bc86405c1459c6cde

Download content.md · Download .ots proof

Verification needs both files: confirm the text’s hash with sha256sum content.md, then check the proof against it — drag both into opentimestamps.org or run ots verify content.md.ots locally.

This page is for informational and research purposes only. Nothing here constitutes financial advice.

← The Oracle & its public record