A straight answer for the business owner who reads three AI newsletters and four Reddit threads every morning with no idea which parts are real.
The Reviewer Who Got Three Fake Papers in One Afternoon
"I was assigned 3 ICLR papers to review. I generally consider myself a pretty nice reviewer but…all 3 of them are slop."
That is a reviewer posting in r/MachineLearning, and I want to be careful handing it to you, because Reddit provenance is exactly what this article is about. I cannot verify that person is who they say they are. What I can tell you is what they said next: all three submissions shared the same core idea, introduced it the same way, and used "the same Claude-sounding prose." Their guess was that somewhere sits "an autoresearch setup."
So here is the direct answer to the headline. You cannot know whether an AI claim is true by reading it, and you never could. You can only know by checking three things: who measured it, whether anyone outside that measurement confirmed it, and whether the specifics survive being looked up.
That is the whole method. Three questions, about ninety seconds, and it filters most of what crosses your desk.
Here is the thing, though. I am not the guy who figured this out and is now handing down tablets. On October 14, 2026, my own research team caught five separate attempts to fool me in one day's sweep of the sources I use to write for you. One nearly worked. I am going to show you all five, because a method you cannot see fail is a sales pitch.
Key Takeaways
- The only reliable test of an AI claim is provenance: who measured it, with what, against what baseline.
- A vendor measuring its own product on its own customers is marketing with a chart attached.
- Upvotes measure how good a thing feels to agree with, and in my research they run opposite to usefulness.
- Fabricated citations in research rose sixfold from 2023 to 2025, so "it was in a paper" proves nothing.
- The strongest signal that a source is honest is that it tells you what it threw away.
The Problem Is Not That You Are Gullible
You are drowning, and the water looks clean. That is a different problem from being naive. The feeds you read are not full of obvious lies. They are full of confident, well-formatted, plausible claims with no measurable content in them, which is much harder to catch.
I have been exactly where you are. For a stretch of 2023 and 2024 I shared things because they sounded right and the person posting them sounded smart. A few I had to walk back publicly. That is an awful feeling, worse when your business is teaching people to trust what you say.
Candidly, I have less margin for that than most people. I have been to prison. I went through bankruptcy. I built a seven-figure agency, lost it, and built it again. When you come back from that, nobody extends you credit on your word, and honestly they should not have to. I rebuilt credibility one verifiable claim at a time, which is a slow way to live and a fantastic way to learn what an unsourced number costs you.
So I take this personally. An unsourced statistic in a post of mine is not a rounding error. It is the whole asset.
And the environment is getting harder. In the same 24 hours as that reviewer's post, r/artificial carried "OpenAI's blockbuster Navier-Stokes proof isn't what we thought it was," the walkback of a claim many smart people had shared. The same day, Kalshi admitted taking a random man's video, using AI to make him the host of an ad, and changing his race doing it.
The consequences are not theoretical. In Mata v. Avianca, Judge P. Kevin Castel sanctioned two New York lawyers and their firm $5,000 in June 2023 over a brief built on ChatGPT-invented cases, complete with fabricated quotations from judges who never wrote them.
Around here we would say the creek is only knee deep. The honest follow-up question is: whose knees?
Here is the reframe that changed how I work. Stop evaluating claims. Start evaluating the measurement behind the claim. A claim is an opinion wearing a number. A measurement has a who, a what, a when and a baseline, and if any of those four is missing, you have not been given evidence. You have been given a vibe.
The Evidence That This Is Structural, Not Personal
The verification problem lives inside the institutions you were taught to trust. Most people assume the fix is better sources. It is reading sources better.
Fabricated citations in published research rose sixfold in two years. A study in The Lancet on May 7, 2026, led by Maxim Topaz at Columbia University, screened more than 2 million papers and 97 million citations and found roughly 4,000 fabricated references across about 2,800 papers. The trend is the story. In 2023, one in every 2,828 papers contained a fabricated reference. By 2025 it was one in 458. In the first seven weeks of 2026, one in 277. I found this through STAT's coverage by Anil Oza, and the detail I keep returning to is that Topaz started the project because it almost happened to him. He checked his own citations, an editor still caught a bad one, and he told STAT: "I was deeply embarrassed: I checked for that, and it still almost happened to me."
When you ask a model for sources, roughly one in five does not exist. Jake Linardon and colleagues at Deakin University published an experimental study in JMIR Mental Health in 2025 (12:e80371). They had GPT-4o write six literature reviews across three mental health conditions, then verified all 176 citations by hand against Google Scholar, Scopus, PubMed and publisher databases. Thirty-five, 19.9 percent, were fabricated outright. Counting real ones carrying errors, nearly two thirds were made up or wrong. Fabrication worsened on less-studied topics, exactly where you most need help.
Funding bends findings, and this is not new. The Cochrane review by Lundh and colleagues (MR000033.pub3, 2017) pooled 75 studies and found industry-sponsored drug and device research reported favorable efficacy results at a risk ratio of 1.27 and favorable conclusions at 1.34 against non-industry work. The explanation is the devastating part. Standard risk-of-bias checklists did not account for the gap, so the authors called industry sponsorship a "meta-bias," a risk factor rather than a bias you can audit line by line. Translated: a vendor's benchmark can be methodologically clean and still be shaped by who paid for it.
Manufactured agreement has a measurable fingerprint, and it is timing. Schoch, Keller, Stier and Yang published a study in Scientific Reports in 2022 (volume 12, article 4572) analyzing every astroturfing campaign Twitter had released. On average, 74 percent of the accounts in a campaign could be identified by co-tweeting and co-retweeting inside a one-minute window, a pattern they found negligible among the regular users those campaigns imitated. Automated accounts, they note, are only a small slice of modern astroturfing. The tell is not that an account is a bot. The tell is that accounts agree on a schedule.
And the haystack roughly doubled. Graphite, a digital marketing agency, sampled 55,400 English-language URLs from Common Crawl published through March 2026 and ran each through three detectors. Primarily AI-generated articles were 35.9 percent of new articles within a year of ChatGPT's launch, 48 percent within two years, and have hovered near half since early 2025. I am labeling that one on purpose: Graphite sells search marketing, and detector counts carry false positives. Note too that the plateau is the opposite of the panic headline.
The System That Caught Five Fakes In One Day
Here is what changed for me. I stopped treating verification as a judgment call and built it as six habits that check each other.
Habit one: provenance before persuasion. Before I ask whether a claim is interesting, I ask who measured it. On October 14, every impressive number in my feed failed. OpenAI claimed weekly active users of Codex and ChatGPT Work among EU small and medium businesses grew more than eightfold since May 2026: OpenAI's telemetry, OpenAI's customers, OpenAI's definition of a small business (200 users or fewer). Anthropic claimed Singapore ranks second of 121 countries in Claude.ai usage per capita, from the Anthropic Economic Index, which is Anthropic measuring Anthropic. Microsoft's Maia 300 claim of 40 percent better performance per megawatt is Microsoft's own number. None are lies. All are unconfirmed.
Habit two: demand a baseline or discard the superlative. Four Product Hunt launches that day claimed to be best in the world against no stated comparison. Kugel 3.5 "beats any other Model out there." Nimble is a "SOTA Decision Model." Retriever AI's page claimed it "beats OpenAI, Anthropic, and Muse on accuracy, runs 5x faster, and costs 300x less," naming no benchmark or methodology. A superlative without a baseline is not a strong claim. It is empty.
Habit three: read the shape of the conversation, not just the words. A thread in r/AI_Agents about evaluator disputes read as a tidy hypothetical with no company named and no numbers in it. Then I looked at the shape: the top comment came from a handle that is literally a product category name, and four accounts agreed with each other in sequence while the original poster replied approvingly to each. Textbook.
Habit four: fingerprint the voice. One commenter handle turned up under unrelated posts in two subreddits with an identical fingerprint: all lowercase, missing apostrophes, run-on clauses with no terminal punctuation, same rhetorical move both times. Third consecutive run that pattern appeared. Separately, one post ended by naming three products unprompted, one of which has not shipped. Placement, not enthusiasm.
Habit five: never sort by popularity. This is the one that nearly got me. On October 14 the top post in two separate subreddits was the same substanceless meme, posted by one account to three communities, scoring 603, 548 and 196 upvotes. Meanwhile the most useful post of the day, a climbing gym operator's account of an AI agent rewriting his day pass waiver and rolling three prices back to a 2024 PDF, had five upvotes. The best posts that day scored 2, 4, 5, 6 and 10. That inversion has held five runs straight. It is not noise. It is the structure of the platform.
Habit six: go find the disagreement. When two credible people hold incompatible positions, that is where the real information is. Ben Tossell wrote in Ben's Bites on October 13, 2026, about self-built software: "But if it works, is secure and performant, why does it really matter? It matters more if you're providing critical infra for customers paying you money, sure. But for your own tools and sites, slop works." The same week, TLDR AI carried Robert C. Martin arguing you should not read AI-written code at all, and should constrain it with unit tests and QA instead. Both are experienced. They cannot both be right in general, so the honest answer depends on your stakes.
Six Steps You Can Run This Week
-
Write the four-part test on a sticky note. Who measured it, what they measured, when, against what baseline. Any claim missing one of the four goes in a "maybe" pile, not your newsletter and not your strategy deck.
-
Label vendor numbers out loud when you share them. Not to be a scold. To protect yourself. "OpenAI reports, from its own telemetry" costs four words and buys the right to be believed on everything else.
-
Sort by new, not by top, and read for specifics. A post with a dollar amount, a date, a tool name and a mistake in it beats thirty that confirm what you believe. The gym operator with five upvotes taught me more than the meme with 603.
-
Check one citation per source, at random. Not all of them. One. If a piece cites six studies, look up the third. If it does not resolve, the other five are suspect, and two minutes just saved you a public correction.
-
Run an AI assistant as your adversary, not your researcher. Do not ask a model for sources. Ask it to attack a claim you already have. Here is the prompt I use, built on my Perfect Prompt Framework 2.0:
[The Job] Pressure-test a claim I am considering repeating publicly to my audience of non-technical small business owners. Repeating something unverified costs credibility I cannot easily rebuild, so find the weak points before I publish. [The Background] The claim: [PASTE THE EXACT CLAIM, VERBATIM]. The source: [WHO PUBLISHED IT AND WHERE]. The claimed measurement: [WHAT WAS MEASURED, SAMPLE SIZE, DATE, BASELINE IF ANY]. My industry is [YOUR INDUSTRY]. Do not search for supporting evidence and do not give me additional citations, because I cannot verify what you generate. [The Deliverable] Four short sections, under 400 words total, from the perspective of a skeptical research methodologist on my side: (1) Who benefits if this claim is believed. (2) What proper measurement would require, and which pieces are missing. (3) The likeliest way this claim is technically true but practically misleading. (4) One sentence I could honestly say instead, hedged to the real confidence level. [The Questions] Ask me any questions you have. -
Say what you cut. Keep a running list of claims you wanted and threw out, then publish it occasionally. I cut three here: an unverified report that an AI model submitted a false homicide tip to Philadelphia police; a case count from Damien Charlotin's AI Hallucination Cases database, because the trackers quoting it disagreed by hundreds for the same month; and a 2025 retraction total, because my sources put 2023 at 10,000, 13,000 and 14,000 and I will not pass along a number I cannot pin down.
Frequently Asked Questions
How can I tell if a statistic in an AI article is real?
Look for four things: who measured it, what they measured, when, and against what baseline. If the article names a company, a sample size and a date, you can go check it. If it says "studies show" or "up to 10x faster," there is nothing to check, and that absence is your answer.
Are AI content detectors accurate enough to rely on?
Not for individual decisions. Renee Hoch, head of publication ethics at PLOS, told STAT they have seen "a lot of false positives" where legitimate references get flagged over formatting or incomplete data. Detectors are useful for trends across thousands of documents. They are unreliable for judging one piece of work or one person.
Should I believe a vendor's benchmark claims about their own AI tool?
Treat them as a hypothesis, not a finding. The Cochrane review by Lundh and colleagues found industry-sponsored studies reported favorable conclusions at a risk ratio of 1.34, and that standard bias checklists did not explain the gap. A vendor's number tells you what to test in your business. It does not tell you what you will get.
Can I just ask ChatGPT to check its own sources?
Do not. Linardon and colleagues verified 176 GPT-4o citations by hand and found 19.9 percent entirely fabricated, with nearly two thirds fabricated or carrying errors. A model asked to verify itself will generate confident verification. Use AI to attack a claim you already have, then check it yourself.
How much time does real verification actually take?
Roughly ninety seconds per claim, and only for claims you intend to repeat. Check who measured it, look up one citation at random, and note whether the source sells the thing it is measuring. You are not auditing the internet. You are protecting your own name.
Nothing To Hide And Nothing To Prove
Go back to that reviewer with three identical papers on their desk.
What broke them was not the fraud. It was the loneliness of being the only person in the process still checking. A companion thread that same day, titled "PhD students, how ya feeling?," carried this: "Either pump out AI papers and neglect your own development, or take it slow and fall behind in the publishing race."
That is your choice too. Checking is slower, and people who skip it will publish more than you this quarter.
Check anyway. What you are actually building, whether you run a climbing gym or a consulting practice or a 500,000-member community, is the moment somebody decides whether your word is worth anything. That is the only asset that compounds, and the only one you cannot buy back after spending it. I know what rebuilding it from zero costs. I would not wish that education on you.
So here is my invitation, and it is not a purchase. Come argue with me. Find a number here that does not hold up and I will correct it in public with your name on it. Catch a staged thread this week and bring it to me. I would rather belong to a small group that checks than a large audience that nods.
The truth does not need your enthusiasm. It needs your attention.
About the author
Jonathan Mast is the founder of White Beard Strategies LLC, where he teaches non-technical entrepreneurs, coaches, consultants and small business owners how to use AI to amplify skills they already have. He serves a 500,000-member entrepreneur community, runs the AI Insiders membership, created the Perfect Prompt Framework 2.0, and speaks on practical AI adoption. He publishes the claims he cut from each article for lack of sourcing, a strange habit to be known for and the one he is proudest of.