How Bad Information Becomes Common Knowledge

Every piece of bad information has an origin story. Someone, somewhere, makes a claim and dresses it up in the language of credibility. They cite a "study" that doesn't exist. They quote an "expert" who isn't one. They reference a report that says something quite different from what they claim it says.

At this stage, the claim is fragile. Anyone who checked the source would see the problem immediately. But most people don't check. The claim sounds plausible, it comes with a citation, and that's usually enough to get it past the first audience. The dodgy source doesn't need to be convincing. It just needs to look like a source.

The reason dodgy citations work is that we're wired to trust authority. From childhood, we learn that experts know things we don't, and that deferring to them is usually sensible. This instinct serves us well most of the time - but it has a blind spot.

We don't just defer to actual expertise. We defer to the appearance of expertise. A confident tone, professional credentials, institutional affiliation, a white coat, a title - these signals trigger our trust response before we've evaluated whether the person has relevant knowledge. Bad actors know this. That's why misinformation so often comes dressed in the costume of authority: "scientists say," "research shows," "a Harvard study found."

Here's where things get insidious. The original claim, with its dodgy source, gets picked up and re-cited. A blog quotes it. A journalist references the blog. Another journalist references that article. Within a few cycles, the claim appears in multiple places - each one citing the others as though they were independent sources.

But they're not independent. They're all pointing back to the same flawed origin. Nobody went back to check the original. They just cited the most recent reference and moved on. The result is a web of citations that looks like a body of evidence but is really just one bad claim bouncing between mirrors.

Even if nobody deliberately amplifies the claim, simple repetition does its own damage. Each time you encounter a statement, your brain files it as slightly more familiar - and familiar things feel true. This happens regardless of whether you believed it the first time. It happens even if you were told it was false.

This is one of the most unsettling findings in cognitive science. We don't have a separate mental filing system for "things I've checked" and "things I've merely heard." Familiarity and truth share the same neural shortcut. The more a claim circulates, the more real it feels - not because anyone has verified it, but because your brain has heard it before.

Sometimes, the journey from bad source to common knowledge isn't accidental. It's engineered. Source laundering is the practice of deliberately moving a claim through a chain of progressively more credible-looking outlets until it appears legitimate.

A fabricated statistic starts on a fringe blog. It gets picked up by a more mainstream-looking site. A think tank cites it. A politician references the think tank. A newspaper reports what the politician said. By the time most people encounter the claim, its origins are buried under layers of apparently respectable sourcing. Tracing it back requires effort that almost nobody will make - which is exactly the point.

All of this would be less effective if we evaluated every claim on its merits. But we don't. When a claim confirms what we already believe, we let it through. When it challenges our worldview, we scrutinise it. This asymmetry isn't a sign of stupidity - it's a universal feature of human cognition.

For bad information, this is rocket fuel. A false claim that aligns with someone's existing beliefs will be shared, cited, and defended without anyone checking the source. Meanwhile, a factual correction that challenges those beliefs will be picked apart, dismissed, or ignored. The claim doesn't need to be true. It just needs to feel right to the person encountering it.

The final stage isn't about a single claim at all. It's about what happens when bad information floods the entire information environment. When so many contradictory claims are circulating that nobody can tell what's true and what isn't, something important shifts: people stop trying to figure it out.

This is the endgame. Not persuasion - exhaustion. When trust in information itself collapses, the people with power can say whatever they want, because the audience has lost the tools to evaluate it. The firehose doesn't need you to believe any particular lie. It just needs you to give up on the idea that truth is findable. And once that happens, accountability becomes nearly impossible.