How the models perform on foresight work.
We ran 34 models against 12 fixed industry briefs. Web-grounded judges scored every output for verifiability, specificity, currency, and coverage.
Web-grounded judge confirms the signal's claim.
Named actors, concrete events, no hype adjectives.
Recent supporting evidence in cited sources.
Balanced across categories; finds non-obvious signals.
Composite leaderboard
Weighted average · Verifiability 0.4 · Specificity 0.3 · Currency 0.15 · Coverage 0.15. Click any header to sort. Click a model name to see its signals.
By challenge
One row per industry brief. Shows the top-3 models, cohort average, and how far apart the best and worst models scored: a quick read on how contested each challenge is.
Full per-industry matrix
Every model's score on every brief. Pick an axis, sort by any column.
| Model | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
86 | 83 | 88 | 88 | 85 | 86 | 82 | 86 | 85 | 85 | 89 | 87 | 86 | |
85 | 83 | 87 | 84 | 83 | 88 | 86 | 85 | 86 | 83 | 85 | 89 | 82 | |
83 | 83 | 85 | 85 | 80 | 83 | 83 | 84 | 81 | 82 | 90 | 83 | 78 | |
83 | 84 | 86 | 86 | 85 | 82 | 81 | 83 | 82 | 81 | 82 | 83 | 76 | |
83 | 83 | 87 | 83 | 85 | 81 | 78 | 83 | 84 | 80 | 81 | 87 | 82 | |
81 | 81 | 85 | 85 | 80 | 85 | 81 | 79 | 78 | 82 | 86 | 82 | 73 | |
80 | 78 | 85 | 81 | 84 | 80 | n/a | n/a | 77 | 81 | 83 | 80 | 74 | |
80 | 78 | 78 | 81 | 82 | 79 | 79 | 82 | 80 | 82 | 79 | 79 | 78 | |
80 | 79 | 82 | 82 | 83 | 78 | n/a | 80 | 80 | n/a | 85 | 75 | 78 | |
80 | 77 | 84 | 80 | 75 | 78 | 78 | 80 | 80 | 80 | 84 | 85 | 76 | |
80 | 77 | 75 | 86 | 84 | 82 | 84 | 82 | 72 | 83 | 83 | 78 | 77 | |
80 | 83 | 84 | 83 | 82 | 76 | 78 | 79 | 77 | 79 | 81 | 76 | 77 | |
79 | 80 | 80 | 82 | 77 | 78 | 82 | 78 | 81 | 81 | 80 | 78 | 73 | |
79 | 80 | 84 | 84 | 75 | 74 | 81 | 84 | 75 | 82 | 78 | 80 | 74 | |
79 | 79 | 81 | 77 | 78 | 79 | 77 | 81 | 77 | 78 | 79 | 79 | 83 | |
79 | 77 | 81 | 83 | n/a | n/a | 78 | 81 | 77 | 80 | n/a | 79 | 78 | |
79 | 79 | 83 | 84 | 81 | 78 | 77 | 79 | 75 | 82 | 75 | 77 | 73 | |
79 | 78 | 83 | 81 | 73 | 78 | 78 | 81 | 78 | 78 | 79 | 78 | 78 | |
78 | 80 | 80 | 80 | 77 | 75 | 77 | 81 | 81 | 75 | 83 | 76 | 73 | |
78 | 82 | 79 | 77 | 71 | 79 | 80 | 81 | 77 | 77 | 77 | 82 | 70 | |
78 | 81 | 86 | 79 | 78 | 77 | 76 | 73 | 79 | 72 | 78 | 76 | 76 | |
78 | 76 | 83 | 78 | n/a | 80 | 75 | 81 | n/a | 76 | 80 | 78 | 76 | |
77 | 75 | 80 | 76 | 80 | 79 | 76 | 75 | 74 | 79 | 79 | 76 | 74 | |
76 | 73 | 80 | 76 | 76 | 75 | 78 | 79 | 74 | 74 | 79 | 75 | 75 | |
76 | 72 | 78 | 75 | 75 | 70 | 76 | 81 | 76 | 78 | 82 | 74 | 71 | |
75 | 77 | 77 | 77 | 77 | 73 | 81 | 68 | 76 | 78 | 73 | 75 | 73 | |
74 | 70 | 77 | 77 | 76 | 65 | 72 | 76 | 72 | 80 | 70 | 76 | 75 | |
74 | 74 | 79 | 74 | 70 | 69 | 77 | 72 | 73 | 74 | 77 | 76 | 73 | |
73 | 70 | 79 | 74 | 75 | 73 | 70 | 73 | 70 | 70 | 70 | 77 | 69 | |
73 | 77 | 73 | 74 | 74 | 74 | 76 | 72 | 72 | 73 | 75 | 69 | 69 | |
72 | 74 | 73 | 71 | 73 | 72 | 72 | 69 | 68 | 76 | 71 | 75 | 69 | |
70 | 75 | 71 | 71 | 71 | 69 | 76 | 63 | 68 | 69 | 69 | 70 | 69 | |
| Reka-Flash-3 | 70 | 73 | 64 | 74 | 73 | 70 | 79 | 77 | 73 | 65 | 63 | 73 | 54 |
69 | 71 | 70 | 70 | 70 | 69 | 71 | 71 | 68 | 67 | 69 | 68 | 69 |
Reading left-to-right shows how consistently a model performs across domains; reading top-to-bottom shows which model is best for a given industry. Click any column header to sort.
Substance vs. style, by model
X = Verifiability · Y = Specificity · dot size = Composite score. Upper-right is the frontier; biggest dot wins overall.
Knowledge cutoff
Currency scores how recent a model’s cited evidence is. This measures how recent its world model is — the point where it stops knowing what happened. Measured by quizzing every model on 215 dated events — all of them real, differing only in when they happened — then finding the month its accuracy drops.
Across models where the curve supported an estimate.
Claude Opus-4.7
Median difference between the cutoff a model states and the one it demonstrates.
Median months between a model's cutoff and the day its lab shipped it.
Where each model stops knowing
Filled dot = measured cutoff. The bar spans the months that fit the curve nearly as well — a wide bar means a gradual decline, not a precise date. Hollow ring = the cutoff the model states when you ask it. Diamond = the cutoff its lab publishes.
| Model | Decay curve | Measured cutoff | Says | Gap | Lab publishes | Released | Stale at release | Currency |
|---|---|---|---|---|---|---|---|---|
| Claude Opus-4.7 anthropic/claude-opus-4.7 | 97% → 36% | Mar 2026 Feb 2026 – Mar 2026 | Jan 2025 | −14 mo | Jan 2026 measured +2 mo | Apr 2026 | 1 mo | 68 |
| GPT-5.4 openai/gpt-5.4 | 98% → 24% | Aug 2025 Jul 2025 – Aug 2025 | Jun 2024 | −14 mo | Aug 2025 | Mar 2026 | 7 mo | 78 |
| GPT-5.4-Mini openai/gpt-5.4-mini | 76% → 12% | Aug 2025 Jul 2025 – Aug 2025 | Jun 2024 | −14 mo | Aug 2025 | Mar 2026 | 7 mo | 83 |
| Claude Sonnet-4.6 anthropic/claude-sonnet-4.6 | 97% → 28% | Jul 2025 Jun 2025 – Aug 2025 | Jan 2025 | −6 mo | Aug 2025 measured −1 mo | Feb 2026 | 7 mo | 68 |
| Claude Opus-4.6 anthropic/claude-opus-4.6 | 97% → 42% | Jun 2025 May 2025 – Jun 2025 | Apr 2025 | −2 mo | May 2025 measured +1 mo | Feb 2026 | 8 mo | 71 |
| Gemini 3.5-Flash google/gemini-3.5-flash | 98% → 41% | Apr 2025 Mar 2025 – Apr 2025 | Jan 2025 | −3 mo | not published | May 2026 | 13 mo | 75 |
| Claude Haiku-4.5 anthropic/claude-haiku-4.5 | 60% → 5% | Jan 2025 Dec 2024 – Mar 2025 | Apr 2024 | −9 mo | Feb 2025 measured −1 mo | Oct 2025 | 9 mo | 81 |
| Qwen Max qwen/qwen3-max | 93% → 6% | Oct 2024 Sep 2024 – Oct 2024 | Jun 2024 | −4 mo | not published | Sep 2025 | 11 mo | 75 |
| DeepSeek deepseek/deepseek-v3.2 | 79% → 5% | Aug 2024 Jul 2024 – Aug 2024 | Oct 2023 | −10 mo | not published | Dec 2025 | 16 mo | 76 |
| GPT-5.5 openai/gpt-5.5 | after window | Jun 2024 | — | Dec 2025 | Apr 2026 | 4 molab | 74 | |
| GPT-5.6-Sol openai/gpt-5.6-sol | after window | Jun 2024 | — | Feb 2026 | Jul 2026 | 5 molab | 68 |
Each model answers the same 8-way multiple-choice questions about real events, bucketed by month. We locate the cutoff as a change point: the month that best splits the curve into a “knows it” level and a “doesn’t” level, weighted by how many questions each month carried. Both levels are measured. The lower one usually sits above chance (13%), because some questions can be partly reasoned out without knowing the month, and assuming it lands at chance dates every model far too late. Expect the result to fall a little before a vendor’s stated cutoff: training data thins out in the final months and models partially anticipate what comes next, so the observable drop precedes the true date. “Lab publishes” is copied by hand from each lab’s model documentation (8 of 11 models here have one); where a lab publishes both a training-data cutoff and a narrower reliable-knowledge date, the table shows the reliable one and the training date on hover. “Stale at release” is the months between that cutoff and the day the model shipped, so a model can be months behind before anyone has used it. Cutoff is reported beside the leaderboard and never folded into the composite: it is a property of the model, not a judgement about quality. Method adapted from Shrivu Shankar’s knowledge-cutoff experiments. Quiz bank 2026-08-v2, drafted and verified with web-grounded models.
Four axes, independent judges
The weights come from Signals’ product purpose, not an external standard. A useful signal of change is, in order: real, concrete, recent, and part of a broad view. Substance > style > recency ≈ breadth.
- Verifiabilityweight 0.40
- A web-grounded judge classifies every signal's claim into one of six buckets (grounded, speculative, future, indicative, dubious, fabricated) and supplies citations. The 'future' bucket protects forward-looking foresight from being misread as hallucination.
- Specificityweight 0.30
- A separate (non-grounded, different vendor) judge scores the signal's writing against an explicit rubric: named actors, concrete events, quantitative anchors, no hype adjectives.
- Currencyweight 0.15
- Newest source-date the verifier surfaced, run through a decay curve.
- Coverageweight 0.15
- Distribution across the brief's categories plus uniqueness vs. the rest of the cohort.
The per-axis sub-scores are reported alongside the composite. If you weight things differently, the raw JSON lets you re-compute the ranking without re-running anything. Knowledge cutoff is measured separately and deliberately left out of the composite — it describes what a model is, not how well it did.
What to read with caution
- No market equivalent (yet)
There's no accepted external standard for grading foresight-style generation, so the weights and rubric reflect our judgement. Treat the composite as informative, not authoritative.
- Judges have biases
The verifier and specificity judges are themselves LLMs. Same-family models can mildly self-favor. We use different vendors for the two judges, and we list which judges ran each leaderboard so consumers can recalibrate.
- Frozen briefs can be gamed
Once a brief is public, a model could in principle be tuned to it. We mitigate by versioning the brief set; cross-run comparisons within the same version are valid, cross-version comparisons aren't.
- The 'future' verdict is judgement-heavy
Forward-looking signals can't be web-verified by definition. We protect them with a dedicated bucket scored mid-range, but it relies on the judge's plausibility call.
- Cutoff estimates are curve-fits
The cutoff timeline is read off a quiz whose questions were drafted and verified by web-grounded models. A wrong answer key adds noise, and some questions can be partly reasoned out without knowing the month, which lifts the floor of every curve. We fit both levels from the data rather than assuming the lower one, report a bracket rather than a point, and show no estimate at all when a model's curve never declines inside the window. Validated against a model with a published cutoff, the estimate landed three months early.
- Maturation comes from volume
Confidence in a benchmark like this comes from running it many times across many domains, watching the rankings stabilize, and cross-validating with different judges. We'll keep publishing dated runs as new models ship.
Reproducible & open
- Run ID
- 2026-05-13T10-10-56-382Z
- Date
- July 11, 2026
- Briefs version
- 2026-05-v1
- Verifier judge
- google/gemini-2.5-flash:online
- Specificity judge
- google/gemini-2.5-flash
- Industries
- Healthcare Regulated AI, Fintech Stablecoin Rails, Defense Autonomous Systems, Climate Adaptation Capital, Retail Genai Commerce, Biotech Platform Shifts, Energy Grid Electrification, Education AI Tutors, Geopolitics Tech Blocs, AI Infrastructure Scaling, Mobility Autonomous Fleets, Food AgTech Shifts
- Compute cost
- $112.80
Benchmark methodology and runner code are open. The same models run every scan inside the product: see how.
Put a live question to work.
Start with the theme your team is debating now.