There’s an old line about how difficult it is to get a person to understand something when their income depends on not understanding it. It gets quoted as an accusation of dishonesty, which is a shame, because the interesting version isn’t about liars at all. It’s about how sincere belief actually forms, and it applies to nearly everyone with a clear view of this situation.

Consider who has the best information. Not journalists, not academics, and certainly not people writing series like this one. The people who can see most clearly are inside the labs and the companies deploying at scale, and they know things about capability and reliability that won’t be public for a year. They are also, to a person, holding equity that vests over several years, working alongside friends, doing the most interesting work of their lives, and staking their professional identity on this mattering and going well.

That doesn’t make them dishonest. It makes them human, and it means their beliefs are formed the way everyone’s are, under conditions. If you have to choose between two readings of an ambiguous result, and one of them implies your work is fine and the other implies you should stop, you don’t consciously pick. You find the first one more persuasive. Every hour of every day, in a thousand small judgment calls, the plausible reading tilts, and nobody experiences a moment of corruption because there isn’t one. Belief follows position the way a plant follows light, without deciding.

Which is complicated by something that genuinely doesn’t fit the cynical story, and I have to be honest about it because this series promised to be. Some of the loudest warnings about all of this have come from the people building it. Insiders say alarming things in public, repeatedly, on the record. That’s the opposite of what a simple bought-silence theory predicts, and anyone who ignores it is telling themselves a comfortable story of their own.

But look at what the warning actually costs, because that’s where the mechanism hides. Saying this could be dangerous while continuing to build it is a stable position. It’s honest, it’s brave-sounding, it signals depth, and it changes nothing about the schedule. Warning became a genre rather than an action, and the genre has a curious property: it inoculates. Once the risk has been publicly acknowledged by the people running toward it, everyone else can relax, because clearly the serious people are on top of it. The warnings are sincere and they function as reassurance, and both of those are true at once.

Now the rest of us, because I don’t want this to be a post about other people’s compromised judgment. We’re not paid in equity, we’re paid in convenience, and it works just as well. Every month this technology makes something in your life easier, and the accumulated effect on your thinking is not neutral. It’s very hard to hold a serious concern about a thing that is, this week, saving you four hours. And the attention system that would have to carry the concern is competing against everything else in the world and losing, partly because a slope is not a story, and partly because the feed deciding what you see is itself the product.

I’d add that this applies to me and to anyone writing on this subject, in the opposite direction. Concern is my position. A series arguing that this is all overblown would be shorter, less interesting, and would not have kept me writing for sixty days. If the ceiling arrives and nothing much happens, I’m the one who spent a year being wrong in public, and I’d be a fool to claim my own beliefs formed in a vacuum. The mechanism doesn’t have a side. It just runs on whoever has a position.

What follows from all this isn’t that nobody can be trusted. It’s narrower and more useful: on this subject, discount everyone’s confidence in proportion to what their life would have to change if they were wrong. That includes the optimists, the doomers, the regulators who need a crisis, and the writer of this post. The people worth listening to are the ones who tell you what would change their mind and then, when it happens, change it.

Tonight’s exercise. Work out what you’re being paid, and I don’t mean money. Name the specific convenience, comfort, professional advantage, or piece of identity that would be uncomfortable to give up if you took this seriously enough to act. Everyone has one. Then ask, honestly, whether your current level of concern is a conclusion you reached or a level that happens to cost you nothing. Monday is a doubt post, and it argues that everything I’ve written this fortnight rests on a control we never had.