Picture yourself running one of the handful of labs building the most powerful AI on the planet. You’re smart. You’ve read the risk arguments, maybe written a few. Privately, over dinner, you’ll admit the pace is uncomfortable. So why don’t you slow down?

Because of the other guys. Obviously.

If you ease off and they don’t, you lose your best researchers, your investors’ patience, and your seat at the table where the future gets decided. And here’s the twist that makes it worse. You believe, sincerely, that you’re the responsible one. So slowing down doesn’t just cost you the race. In your head, it hands the most dangerous technology ever built to people less careful than you. Your conscience just became an accelerant.

Now the fun part. Every lab runs this exact logic. Every one of them is staffed with genuinely thoughtful people who lose sleep over this, and every one of them concludes that the responsible move is to go faster, but carefully. Whatever “carefully” means at a full sprint.

Game theory has an old story for this shape of problem. Two prisoners, separate rooms, each one better off betraying the other no matter what the other does, so both betray, and both end up worse than if they’d cooperated. Nobody in that story is stupid. Nobody is evil. The structure does all the work. You could swap in saints and get the same outcome.

That’s the thing people miss when they go looking for villains here. There’s no mustache-twirler. There’s a structure, and the structure eats good intentions for breakfast.

You can watch it eat them in real time. A researcher gets worried, quits a big lab on principle, and then, more than once now in this industry, immediately founds a competing lab. Read that sentence again. The sincere act of protest against the race was to enter the race. And given the logic above, it made sense to them. If the thing is coming anyway, better it comes from me.

“If the thing is coming anyway” might be the most expensive phrase of the decade. It converts every doubt into fuel. Worried about safety? Better win, so the careful people are in charge. Worried about concentration of power? Better win, so the good guys hold it. Worried it might end badly for everyone? All the more reason it should end badly on your terms. There is no fear this phrase can’t metabolize into speed.

The people inside know all this. That’s what makes it tragic instead of just annoying. Talk to anyone senior in this world and you’ll eventually hear the same quiet sentence, usually after the second drink. I wish we could all slow down together. Together is doing heroic work in that sentence. Together needs a mechanism, an enforcer, a referee. We’ll get to what happened to the referees in a couple of weeks. Spoiler: nothing good.

Couldn’t the labs just agree among themselves? Sign something? They’ve tried versions of it. But a promise between competitors, with nobody checking and a market screaming for speed, has the approximate lifespan of a snowman in Dubai. The first quarter the promise costs real money, it develops exceptions.

So the race runs itself. Nobody’s driving. Everyone’s steering.

Tonight’s experiment. Imagine you and your fiercest rival each have a button. Press it and you get enormous power, but with some unknown chance that things go wrong for everyone. You truly believe you’re more careful than they are. And you’re certain they’re reaching for their button right now. Sit with what your hand does. Then remember that a few thousand people, right now, aren’t imagining it.