AI Prediction Accountability
A sourced scoreboard of the AI industry’s dated predictions.
Every entry is a public statement with a date, a deadline, and a link to the primary source — scored only against verifiable outcomes. Bulls and skeptics alike, hits and misses both. No commentary that isn’t backed by a citation. Read the receipts and judge for yourself.
14 of 21 independently-verified claims have reached their deadline. Partial counts as half.
- FAILED
- 7
- PARTIAL
- 5
- FULFILLED
- 3
- PENDING
- 6
- UNFALSIFIABLE
- 2
Calibration standings
Hit rate across resolved, source-verified calls. Partial counts as half. Cuts both ways — skeptics included.
- 1Gary MarcusAI researcher; author of “Marcus on AI”5 resolved80%
- 2Sam AltmanCEO, OpenAI3 resolved33%
- 3David ShapiroAI commentator & author5 resolved10%
- 4Dario AmodeiCEO, Anthropic1 resolved0%
The ledger
23 entries · newest first- David ShapiroJan 2026UNFALSIFIABLE
"85% Of People Will be Unemployable. According to my models, only 15% of working age adults will be employed once AI and robotics take off."
Deadline: "Once AI and robotics take off" — no fixed date1 sourceView evidence → - David ShapiroJan 2026UNFALSIFIABLE
"Both methods point to roughly 200,000 to 300,000 U.S. jobs displaced or foregone due to AI in 2025."
1 sourceView evidence → - David ShapiroDec 2025PENDING
"In 2026 at least one — and probably several — companies (Figure, Tesla Optimus, Unitree, Boston Dynamics Atlas, others) will cross into genuine product-market fit (PMF)." Shapiro called 2026 the "year of the robot."
Deadline: During 20261 sourceView evidence → - David ShapiroOct 2025PENDINGsource unconfirmed
"I'm updating my predictions. At the end of 2024 I said: 2025 — the year of the agent (so far, quite true); 2026 — the year of the robot; 2027 — the year of superintelligence. I now think that superintelligence will also happen in 2026."
Deadline: 20261 sourceView evidence → - Sam AltmanJun 2025PARTIAL
"2025 has seen the arrival of agents that can do real cognitive work… 2026 will likely see the arrival of systems that can figure out novel insights… 2027 may see the arrival of robots that can do tasks in the real world."
Deadline: 2025 / 2026 / 20271 sourceView evidence → - Dario AmodeiMay 2025PENDING
AI could wipe out half of all entry-level white-collar jobs and spike unemployment to 10–20% in the next one to five years.
Deadline: Within 1–5 years (by ~2030)1 sourceView evidence → - Dario AmodeiMar 2025FAILED
"I think we'll be there in three to six months — where AI is writing 90 percent of the code. And then in twelve months, we may be in a world where AI is writing essentially all of the code."
Deadline: 90% by ~Sep 2025; “all code” by ~Mar 20262 sourcesView evidence → - Dario AmodeiFeb 2025PENDING
"Possibly by 2026 or 2027 (and almost certainly no later than 2030)… a ‘country of geniuses in a datacenter.’"
Deadline: 2026–2027 (“no later than 2030”)1 sourceView evidence → - Sam AltmanJan 2025PARTIAL
"We believe that, in 2025, we may see the first AI agents ‘join the workforce’ and materially change the output of companies."
Deadline: During 20251 sourceView evidence → - Gary MarcusJan 2025PARTIAL
For 2025: no AGI; under ~10% of the workforce replaced by AI; driverless cars still geographically limited; possibly no community-consensus ‘GPT-5-level’ leap.
Deadline: End of 20251 sourceView evidence → - David ShapiroDec 2024PARTIAL
"At the end of 2024 I said that 2025 would be the year of the agent and 2026 would be the year of the robot. I hold to that. 2027 is the year of superintelligence."
Deadline: 2025 (agents), 2026 (robots), 2027 (superintelligence)1 sourceView evidence → - David ShapiroOct 2024FAILED
"Why I'm quitting AI… Mostly I'm just quitting AI on YouTube and I'm quitting the content mill… I'm going to wrap up all my AI-related projects."
Deadline: Stated as effective immediately2 sourcesView evidence → - Dario AmodeiOct 2024PENDING
"AI-enabled biology and medicine will allow us to compress the progress that human biologists would have achieved over the next 50–100 years into 5–10 years" — the “compressed 21st century.”
Deadline: 5–10 years after “powerful AI” (earliest ~2031–2036)1 sourceView evidence → - Sam AltmanSep 2024PENDING
"It is possible that we will have superintelligence in a few thousand days (!); it may take longer, but I'm confident we'll get there."
Deadline: “A few thousand days” (~2027–2035)1 sourceView evidence → - David ShapiroSep 2024FAILED
"Maybe I was right, and we achieved AGI in September of 2024? We need to wait for the benchmarks, but we just had a major step in that direction."
1 sourceView evidence → - David ShapiroJul 2024FAILEDsource unconfirmed
"I have predicted superintelligence by 2027 and a technical academic AGI in about 2025… Real deal AGI I expect to be later in 2025 through the end of 2026."
Deadline: Technical AGI ~2025; "real deal" AGI by end of 20261 sourceView evidence → - Gary MarcusApr 2024FULFILLED
"$1 million (later raised to $10M) says" AI will not be smarter than any individual human by the end of 2025.
Deadline: Dec 31, 20251 sourceView evidence → - Gary MarcusMar 2024FULFILLED
By end of 2024: many GPT-4-level models, no massive advance (no GPT-5, or a disappointing one), price wars, little moat, no robust fix for hallucinations, and only modest corporate adoption and profits.
Deadline: End of 20242 sourcesView evidence → - David ShapiroOct 2023FAILED
"Earlier this year I predicted that we would have AGI within 18 months — that was March of 2023, so that means my prediction was by September 24, 2024 we would have AGI. I am here to reaffirm that prediction. We will have AGI within 12 months."
Deadline: By September 24, 20241 sourceView evidence → - David ShapiroMar 2023FAILED
"In 18 months any possible definition of AGI that you have will be satisfied." Shapiro framed this as AGI arriving within 18 months of March 2023 — i.e. by roughly September 2024.
Deadline: By ~September 20242 sourcesView evidence → - Gary MarcusDec 2022FULFILLED
Seven predictions about GPT-4: it would still hallucinate, remain unreliable at physical/psychological/mathematical reasoning, not give reliable medical advice, and not be safely hooked up to downstream programs.
Deadline: On GPT-4's release (2023)1 sourceView evidence → - Gary MarcusMar 2022PARTIAL
"Deep learning is hitting a wall" — scaling makes models more fluent but not more trustworthy, with diminishing returns on reasoning, truthfulness and common sense.
1 sourceView evidence → - Sam AltmanMar 2021FAILED
"Imagine a world where, for decades, everything — housing, education, food, clothing, etc. — became half as expensive every two years."
Deadline: “For decades” (ongoing from 2021)1 sourceView evidence →