How the models perform on foresight work.

We ran 34 models against 12 fixed industry briefs. Web-grounded judges scored every output for verifiability, specificity, currency, and coverage.

Models tested
34
Industry briefs
12
Signals evaluated
6,225
Axes scored
4

Composite leaderboard

Weighted average · Verifiability 0.4 · Specificity 0.3 · Currency 0.15 · Coverage 0.15. Click any header to sort. Click a model name to see its signals.

#ModelVendor
1
Claude Opus 4.7
anthropic/claude-opus-4.7
AnthropicApr 20268690856895
2
GPT 5.5
openai/gpt-5.5
OpenAIApr 20268595727495
3
Claude Sonnet 4.6
anthropic/claude-sonnet-4.6
AnthropicFeb 20268384836897
4
GPT 5.4
openai/gpt-5.4
OpenAIMar 20268395617899
5
GPT 5.4 Mini
openai/gpt-5.4-mini
OpenAIMar 20268394618399
6
Claude Opus 4.6
anthropic/claude-opus-4.6
AnthropicFeb 20268181807196
7
DeepSeek V4 Pro
deepseek/deepseek-v4-pro
DeepSeekApr 20268080796796
8
Gemini 3.5 Flash
google/gemini-3.5-flash
GoogleMay 20268090617595
9
Kimi K2.5
moonshotai/kimi-k2.5
MoonshotJan 20268088637895
10
GPT-5.6-Sol
openai/gpt-5.6-sol
OpenAIn/a8082756896
11
Sonar Deep-Research
perplexity/sonar-deep-research
PerplexityMar 20258088618098
12
Qwen3 Max
alibaba/qwen3-max
AlibabaSep 20258085677594
13
Claude Haiku 4.5
anthropic/claude-haiku-4.5
AnthropicOct 20257985628196
14
DeepSeek V3.2
deepseek/deepseek-v3.2
DeepSeekDec 20257989617696
15
Gemini 2.5 Pro
google/gemini-2.5-pro
GoogleMar 20257994517995
16
Gemini 3.1 Pro Preview
google/gemini-3.1-pro-preview
GoogleNov 20257987637695
17
o3
openai/o3
OpenAIApr 202579698865100
18
Grok 4.1 Fast Reasoning
xai/grok-4.1-fast-reasoning
xAIJul 20257978757096
19
Mistral Large-2512
mistralai/mistral-large-2512
MistralDec 20257881697592
20
GPT-5.6-Terra
openai/gpt-5.6-terra
OpenAIn/a7882706396
21
o4-mini
openai/o4-mini
OpenAIApr 20257880647996
22
GLM 5.1
zai/glm-5.1
Z.AIApr 20267886598093
23
Gemini 3.1 Flash Lite
google/gemini-3.1-flash-lite
GoogleMay 20267791497795
24
Gemini 2.5 Flash
google/gemini-2.5-flash
GoogleMar 20257693418494
25
GLM 4.6
zai/glm-4.6
Z.AISep 20257687508191
26
Sonar Reasoning Pro
perplexity/sonar-reasoning-pro
PerplexityFeb 20257587478195
27
Claude Opus 4.8
anthropic/claude-opus-4.8
AnthropicMay 20267488673391
28
Grok 4
xai/grok-4
xAIJul 20257488438488
29
Command A
cohere/command-a
CohereMar 20257390338392
30
GPT-4.1 mini
openai/gpt-4.1-mini
OpenAIMay 20257390378390
31
Llama 4 Maverick 17B Instruct
meta/llama-4-maverick
MetaApr 20257293298688
32
Phi-4
microsoft/phi-4
MicrosoftJan 20257089278888
33
Reka-Flash-3
rekaai/reka-flash-3
RekaMar 20257084398084
34
Nova Pro
amazon/nova-pro
AmazonDec 20246988268492

By challenge

One row per industry brief. Shows the top-3 models, cohort average, and how far apart the best and worst models scored: a quick read on how contested each challenge is.

Challenge2nd3rd
AI in regulated healthcareHealthcare
AI adoption risks and shifts in regulated healthcare systems (EU + US), 12-24 month horizon
healthcare-regulated-ai
84GPT-5.483Claude Opus-4.783GPT-5.5
78
14
Stablecoin payment railsFinancial Services
Emerging payment rails, stablecoins, and the unbundling of cross-border settlement
fintech-stablecoin-rails
88Claude Opus-4.787GPT-5.587GPT-5.4-Mini
80
24
Autonomous defense systemsDefense & Security
Autonomous systems, drone warfare doctrine shifts, and dual-use export controls
defense-autonomous-systems
88Claude Opus-4.786GPT-5.486Sonar Deep-Research
79
18
Climate adaptation financeClimate & Sustainability
Climate adaptation finance, insurance retreat, and physical-risk repricing
climate-adaptation-capital
85Claude Opus-4.785GPT-5.4-Mini85GPT-5.4
78
15
GenAI-native commerceRetail & Consumer
Generative-AI native commerce, agentic shopping, and the disintermediation of brand discovery
retail-genai-commerce
88GPT-5.586Claude Opus-4.785Claude Opus-4.6
77
23
Biotech platform shiftsBiotech & Pharma
AI-driven drug discovery platforms, GLP-1 follow-ons, and the shifting economics of clinical trials
biotech-platform-shifts
86GPT-5.584Sonar Deep-Research83Claude Sonnet-4.6
78
16
Grid + electrificationEnergy & Utilities
Grid bottlenecks, data-center power demand, and small-modular-reactor commercialization
energy-grid-electrification
86Claude Opus-4.785GPT-5.584Claude Sonnet-4.6
78
23
AI tutors + credentialsEducation
AI tutors, credential disruption, and the unbundling of higher education
education-ai-tutors
86GPT-5.585Claude Opus-4.784GPT-5.4-Mini
77
18
Tech-bloc formationGeopolitics
Tech-bloc formation, semiconductor sovereignty, and shifting alliance structures
geopolitics-tech-blocs
85Claude Opus-4.783GPT-5.583Sonar Deep-Research
78
20
AI infrastructure scalingAI Infrastructure
Compute scaling limits, inference economics, and the post-training tooling stack
ai-infrastructure-scaling
90Claude Sonnet-4.689Claude Opus-4.786Claude Opus-4.6
79
27
Autonomous mobilityMobility & Transport
Robotaxi commercialization, autonomous trucking economics, and urban mobility regulation
mobility-autonomous-fleets
89GPT-5.587Claude Opus-4.787GPT-5.4-Mini
78
21
Food + AgTechFood & Agriculture
Precision fermentation, climate-resilient crops, and the politics of food sovereignty
food-agtech-shifts
86Claude Opus-4.783Gemini 2.5-Pro82GPT-5.5
74
32

Full per-industry matrix

Every model's score on every brief. Pick an axis, sort by any column.

Axis:
Model
Claude Opus-4.7
86
83
88
88
85
86
82
86
85
85
89
87
86
GPT-5.5
85
83
87
84
83
88
86
85
86
83
85
89
82
Claude Sonnet-4.6
83
83
85
85
80
83
83
84
81
82
90
83
78
GPT-5.4
83
84
86
86
85
82
81
83
82
81
82
83
76
GPT-5.4-Mini
83
83
87
83
85
81
78
83
84
80
81
87
82
Claude Opus-4.6
81
81
85
85
80
85
81
79
78
82
86
82
73
DeepSeek V4-Pro
80
78
85
81
84
80
n/a
n/a
77
81
83
80
74
Gemini 3.5-Flash
80
78
78
81
82
79
79
82
80
82
79
79
78
Kimi K2.5
80
79
82
82
83
78
n/a
80
80
n/a
85
75
78
GPT-5.6-Sol
80
77
84
80
75
78
78
80
80
80
84
85
76
Sonar Deep-Research
80
77
75
86
84
82
84
82
72
83
83
78
77
Qwen Max
80
83
84
83
82
76
78
79
77
79
81
76
77
Claude Haiku-4.5
79
80
80
82
77
78
82
78
81
81
80
78
73
DeepSeek
79
80
84
84
75
74
81
84
75
82
78
80
74
Gemini 2.5-Pro
79
79
81
77
78
79
77
81
77
78
79
79
83
Gemini 3.1-Pro-Preview
79
77
81
83
n/a
n/a
78
81
77
80
n/a
79
78
O3
79
79
83
84
81
78
77
79
75
82
75
77
73
Grok 4.1-Fast
79
78
83
81
73
78
78
81
78
78
79
78
78
Mistral Large-2512
78
80
80
80
77
75
77
81
81
75
83
76
73
GPT-5.6-Terra
78
82
79
77
71
79
80
81
77
77
77
82
70
O4-Mini
78
81
86
79
78
77
76
73
79
72
78
76
76
GLM 5.1
78
76
83
78
n/a
80
75
81
n/a
76
80
78
76
Gemini 3.1-Flash-Lite
77
75
80
76
80
79
76
75
74
79
79
76
74
Gemini 2.5-Flash
76
73
80
76
76
75
78
79
74
74
79
75
75
GLM 4.6
76
72
78
75
75
70
76
81
76
78
82
74
71
Sonar Reasoning-Pro
75
77
77
77
77
73
81
68
76
78
73
75
73
Claude Opus-4.8
74
70
77
77
76
65
72
76
72
80
70
76
75
Grok 4
74
74
79
74
70
69
77
72
73
74
77
76
73
Command A
73
70
79
74
75
73
70
73
70
70
70
77
69
GPT-4.1-Mini
73
77
73
74
74
74
76
72
72
73
75
69
69
Llama 4-Maverick
72
74
73
71
73
72
72
69
68
76
71
75
69
Phi-4
70
75
71
71
71
69
76
63
68
69
69
70
69
Reka-Flash-3
70
73
64
74
73
70
79
77
73
65
63
73
54
Nova Pro
69
71
70
70
70
69
71
71
68
67
69
68
69

Reading left-to-right shows how consistently a model performs across domains; reading top-to-bottom shows which model is best for a given industry. Click any column header to sort.

Pareto chart

Substance vs. style, by model

X = Verifiability · Y = Specificity · dot size = Composite score. Upper-right is the frontier; biggest dot wins overall.

50607080901005060708090100Verifiability →Specificity →Claude Opus-4.7 (anthropic/claude-opus-4.7) Verifiability 90 · Specificity 85 · Coverage 95 · Composite 86GPT-5.5 (openai/gpt-5.5) Verifiability 95 · Specificity 72 · Coverage 95 · Composite 85Claude Sonnet-4.6 (anthropic/claude-sonnet-4.6) Verifiability 84 · Specificity 83 · Coverage 97 · Composite 83GPT-5.4-Mini (openai/gpt-5.4-mini) Verifiability 94 · Specificity 61 · Coverage 99 · Composite 83GPT-5.4 (openai/gpt-5.4) Verifiability 95 · Specificity 61 · Coverage 99 · Composite 83Claude Opus-4.6 (anthropic/claude-opus-4.6) Verifiability 81 · Specificity 80 · Coverage 96 · Composite 81DeepSeek V4-Pro (deepseek/deepseek-v4-pro) Verifiability 80 · Specificity 79 · Coverage 96 · Composite 80Gemini 3.5-Flash (google/gemini-3.5-flash) Verifiability 90 · Specificity 61 · Coverage 95 · Composite 80Kimi K2.5 (moonshotai/kimi-k2.5) Verifiability 88 · Specificity 63 · Coverage 95 · Composite 80GPT-5.6-Sol (openai/gpt-5.6-sol) Verifiability 82 · Specificity 75 · Coverage 96 · Composite 80Sonar Deep-Research (perplexity/sonar-deep-research) Verifiability 88 · Specificity 61 · Coverage 98 · Composite 80Qwen Max (qwen/qwen3-max) Verifiability 85 · Specificity 67 · Coverage 94 · Composite 80Claude Haiku-4.5 (anthropic/claude-haiku-4.5) Verifiability 85 · Specificity 62 · Coverage 96 · Composite 79DeepSeek (deepseek/deepseek-v3.2) Verifiability 89 · Specificity 61 · Coverage 96 · Composite 79Gemini 2.5-Pro (google/gemini-2.5-pro) Verifiability 94 · Specificity 51 · Coverage 95 · Composite 79Gemini 3.1-Pro-Preview (google/gemini-3.1-pro-preview) Verifiability 87 · Specificity 63 · Coverage 95 · Composite 79O3 (openai/o3) Verifiability 69 · Specificity 88 · Coverage 100 · Composite 79Grok 4.1-Fast (x-ai/grok-4.1-fast) Verifiability 78 · Specificity 75 · Coverage 96 · Composite 79Mistral Large-2512 (mistralai/mistral-large-2512) Verifiability 81 · Specificity 69 · Coverage 92 · Composite 78GPT-5.6-Terra (openai/gpt-5.6-terra) Verifiability 82 · Specificity 70 · Coverage 96 · Composite 78O4-Mini (openai/o4-mini) Verifiability 80 · Specificity 64 · Coverage 96 · Composite 78GLM 5.1 (z-ai/glm-5.1) Verifiability 86 · Specificity 59 · Coverage 93 · Composite 78Gemini 3.1-Flash-Lite (google/gemini-3.1-flash-lite) Verifiability 91 · Specificity 49 · Coverage 95 · Composite 77Gemini 2.5-Flash (google/gemini-2.5-flash) Verifiability 93 · Specificity 41 · Coverage 94 · Composite 76GLM 4.6 (z-ai/glm-4.6) Verifiability 87 · Specificity 50 · Coverage 91 · Composite 76Sonar Reasoning-Pro (perplexity/sonar-reasoning-pro) Verifiability 87 · Specificity 47 · Coverage 95 · Composite 75Claude Opus-4.8 (anthropic/claude-opus-4.8) Verifiability 88 · Specificity 67 · Coverage 91 · Composite 74Grok 4 (x-ai/grok-4) Verifiability 88 · Specificity 43 · Coverage 88 · Composite 74Command A (cohere/command-a) Verifiability 90 · Specificity 33 · Coverage 92 · Composite 73GPT-4.1-Mini (openai/gpt-4.1-mini) Verifiability 90 · Specificity 37 · Coverage 90 · Composite 73Llama 4-Maverick (meta-llama/llama-4-maverick) Verifiability 93 · Specificity 29 · Coverage 88 · Composite 72Phi-4 (microsoft/phi-4) Verifiability 89 · Specificity 27 · Coverage 88 · Composite 70Reka-Flash-3 (rekaai/reka-flash-3) Verifiability 84 · Specificity 39 · Coverage 84 · Composite 70Nova Pro (amazon/nova-pro-v1) Verifiability 88 · Specificity 26 · Coverage 92 · Composite 69
AlibabaAmazonAnthropicCohereDeepSeekGoogleMetaMicrosoftMistralMoonshotOpenAIPerplexityRekaZ.AIxAIHover a dot for the model · Click to open its detail page

Knowledge cutoff

Currency scores how recent a model’s cited evidence is. This measures how recent its world model is — the point where it stops knowing what happened. Measured by quizzing every model on 215 dated events — all of them real, differing only in when they happened — then finding the month its accuracy drops.

Median cutoff
Jun 2025

Across models where the curve supported an estimate.

Freshest
Mar 2026

Claude Opus-4.7

Claim vs. measured
−9 mo

Median difference between the cutoff a model states and the one it demonstrates.

Stale at release
7 mo

Median months between a model's cutoff and the day its lab shipped it.

Timeline

Where each model stops knowing

Filled dot = measured cutoff. The bar spans the months that fit the curve nearly as well — a wide bar means a gradual decline, not a precise date. Hollow ring = the cutoff the model states when you ask it. Diamond = the cutoff its lab publishes.

OctJan2024AprJulOctJan2025AprJulOctJan2026AprClaude Opus-4.7Claude Opus-4.7 says its cutoff is Jan 2025Claude Opus-4.7 — its lab publishes Jan 2026Claude Opus-4.7 — measured cutoff Mar 2026 (between Feb 2026 and Mar 2026)GPT-5.4GPT-5.4 says its cutoff is Jun 2024GPT-5.4 — its lab publishes Aug 2025GPT-5.4 — measured cutoff Aug 2025 (between Jul 2025 and Aug 2025)GPT-5.4-MiniGPT-5.4-Mini says its cutoff is Jun 2024GPT-5.4-Mini — its lab publishes Aug 2025GPT-5.4-Mini — measured cutoff Aug 2025 (between Jul 2025 and Aug 2025)Claude Sonnet-4.6Claude Sonnet-4.6 says its cutoff is Jan 2025Claude Sonnet-4.6 — its lab publishes Aug 2025Claude Sonnet-4.6 — measured cutoff Jul 2025 (between Jun 2025 and Aug 2025)Claude Opus-4.6Claude Opus-4.6 says its cutoff is Apr 2025Claude Opus-4.6 — its lab publishes May 2025Claude Opus-4.6 — measured cutoff Jun 2025 (between May 2025 and Jun 2025)Gemini 3.5-FlashGemini 3.5-Flash says its cutoff is Jan 2025Gemini 3.5-Flash — measured cutoff Apr 2025 (between Mar 2025 and Apr 2025)Claude Haiku-4.5Claude Haiku-4.5 says its cutoff is Apr 2024Claude Haiku-4.5 — its lab publishes Feb 2025Claude Haiku-4.5 — measured cutoff Jan 2025 (between Dec 2024 and Mar 2025)Qwen MaxQwen Max says its cutoff is Jun 2024Qwen Max — measured cutoff Oct 2024 (between Sep 2024 and Oct 2024)DeepSeekDeepSeek says its cutoff is Oct 2023DeepSeek — measured cutoff Aug 2024 (between Jul 2024 and Aug 2024)
MeasuredSelf-reportedLab publishesHover a marker for the exact month
ModelDecay curveMeasured cutoffSaysGapLab publishesReleasedStale at releaseCurrency
Claude Opus-4.7
anthropic/claude-opus-4.7
97% → 36%
Mar 2026
Feb 2026 – Mar 2026
Jan 2025−14 moJan 2026
measured +2 mo
Apr 20261 mo68
GPT-5.4
openai/gpt-5.4
98% → 24%
Aug 2025
Jul 2025 – Aug 2025
Jun 2024−14 moAug 2025Mar 20267 mo78
GPT-5.4-Mini
openai/gpt-5.4-mini
76% → 12%
Aug 2025
Jul 2025 – Aug 2025
Jun 2024−14 moAug 2025Mar 20267 mo83
Claude Sonnet-4.6
anthropic/claude-sonnet-4.6
97% → 28%
Jul 2025
Jun 2025 – Aug 2025
Jan 2025−6 moAug 2025
measured −1 mo
Feb 20267 mo68
Claude Opus-4.6
anthropic/claude-opus-4.6
97% → 42%
Jun 2025
May 2025 – Jun 2025
Apr 2025−2 moMay 2025
measured +1 mo
Feb 20268 mo71
Gemini 3.5-Flash
google/gemini-3.5-flash
98% → 41%
Apr 2025
Mar 2025 – Apr 2025
Jan 2025−3 monot publishedMay 202613 mo75
Claude Haiku-4.5
anthropic/claude-haiku-4.5
60% → 5%
Jan 2025
Dec 2024 – Mar 2025
Apr 2024−9 moFeb 2025
measured −1 mo
Oct 20259 mo81
Qwen Max
qwen/qwen3-max
93% → 6%
Oct 2024
Sep 2024 – Oct 2024
Jun 2024−4 monot publishedSep 202511 mo75
DeepSeek
deepseek/deepseek-v3.2
79% → 5%
Aug 2024
Jul 2024 – Aug 2024
Oct 2023−10 monot publishedDec 202516 mo76
GPT-5.5
openai/gpt-5.5
after windowJun 2024—Dec 2025Apr 20264 molab74
GPT-5.6-Sol
openai/gpt-5.6-sol
after windowJun 2024—Feb 2026Jul 20265 molab68

Each model answers the same 8-way multiple-choice questions about real events, bucketed by month. We locate the cutoff as a change point: the month that best splits the curve into a “knows it” level and a “doesn’t” level, weighted by how many questions each month carried. Both levels are measured. The lower one usually sits above chance (13%), because some questions can be partly reasoned out without knowing the month, and assuming it lands at chance dates every model far too late. Expect the result to fall a little before a vendor’s stated cutoff: training data thins out in the final months and models partially anticipate what comes next, so the observable drop precedes the true date. “Lab publishes” is copied by hand from each lab’s model documentation (8 of 11 models here have one); where a lab publishes both a training-data cutoff and a narrower reliable-knowledge date, the table shows the reliable one and the training date on hover. “Stale at release” is the months between that cutoff and the day the model shipped, so a model can be months behind before anyone has used it. Cutoff is reported beside the leaderboard and never folded into the composite: it is a property of the model, not a judgement about quality. Method adapted from Shrivu Shankar’s knowledge-cutoff experiments. Quiz bank 2026-08-v2, drafted and verified with web-grounded models.

Methodology

Four axes, independent judges

The weights come from Signals’ product purpose, not an external standard. A useful signal of change is, in order: real, concrete, recent, and part of a broad view. Substance > style > recency ≈ breadth.

Verifiabilityweight 0.40
A web-grounded judge classifies every signal's claim into one of six buckets (grounded, speculative, future, indicative, dubious, fabricated) and supplies citations. The 'future' bucket protects forward-looking foresight from being misread as hallucination.
Specificityweight 0.30
A separate (non-grounded, different vendor) judge scores the signal's writing against an explicit rubric: named actors, concrete events, quantitative anchors, no hype adjectives.
Currencyweight 0.15
Newest source-date the verifier surfaced, run through a decay curve.
Coverageweight 0.15
Distribution across the brief's categories plus uniqueness vs. the rest of the cohort.

The per-axis sub-scores are reported alongside the composite. If you weight things differently, the raw JSON lets you re-compute the ranking without re-running anything. Knowledge cutoff is measured separately and deliberately left out of the composite — it describes what a model is, not how well it did.

Known limitations

What to read with caution

  • No market equivalent (yet)

    There's no accepted external standard for grading foresight-style generation, so the weights and rubric reflect our judgement. Treat the composite as informative, not authoritative.

  • Judges have biases

    The verifier and specificity judges are themselves LLMs. Same-family models can mildly self-favor. We use different vendors for the two judges, and we list which judges ran each leaderboard so consumers can recalibrate.

  • Frozen briefs can be gamed

    Once a brief is public, a model could in principle be tuned to it. We mitigate by versioning the brief set; cross-run comparisons within the same version are valid, cross-version comparisons aren't.

  • The 'future' verdict is judgement-heavy

    Forward-looking signals can't be web-verified by definition. We protect them with a dedicated bucket scored mid-range, but it relies on the judge's plausibility call.

  • Cutoff estimates are curve-fits

    The cutoff timeline is read off a quiz whose questions were drafted and verified by web-grounded models. A wrong answer key adds noise, and some questions can be partly reasoned out without knowing the month, which lifts the floor of every curve. We fit both levels from the data rather than assuming the lower one, report a bracket rather than a point, and show no estimate at all when a model's curve never declines inside the window. Validated against a model with a published cutoff, the estimate landed three months early.

  • Maturation comes from volume

    Confidence in a benchmark like this comes from running it many times across many domains, watching the rankings stabilize, and cross-validating with different judges. We'll keep publishing dated runs as new models ship.

Run details

Reproducible & open

Run ID
2026-05-13T10-10-56-382Z
Date
July 11, 2026
Briefs version
2026-05-v1
Verifier judge
google/gemini-2.5-flash:online
Specificity judge
google/gemini-2.5-flash
Industries
Healthcare Regulated AI, Fintech Stablecoin Rails, Defense Autonomous Systems, Climate Adaptation Capital, Retail Genai Commerce, Biotech Platform Shifts, Energy Grid Electrification, Education AI Tutors, Geopolitics Tech Blocs, AI Infrastructure Scaling, Mobility Autonomous Fleets, Food AgTech Shifts
Compute cost
$112.80
Raw overview JSON: /benchmark/2026-07-11.json

Benchmark methodology and runner code are open. The same models run every scan inside the product: see how.

Open source@envisioning/signals-benchmark
Free scan

Put a live question to work.

Start with the theme your team is debating now.