If you go looking for the person who decided any of this, you won’t find one. There’s no meeting, no memo, no signature. Most people find that comforting, on the grounds that a thing with no villain can’t be a conspiracy. It isn’t comforting. It’s the hardest part.
Look at what the last two weeks have actually described. A manager who doesn’t hire a junior, because this year’s numbers say don’t. A hospital that reorganizes around a system that works. A controller who approves in under two seconds, because the dashboard rewards it. A person who cancels nothing, because the service is good. Every one of those people is behaving sensibly given what’s in front of them, and I mean that without sarcasm. Put me in any of those chairs with the same information and the same accountability and I’d do the same thing, and so would you.
What you get from ten thousand of those is a destination nobody selected. This is a specific and well understood kind of failure: the incentives at each local point don’t add up to the outcome anybody wanted globally, and there’s no mechanism that ever compares the two. It’s how a river silts up. Every grain of sand is behaving exactly as physics requires. Nobody is blocking the river.
The reason this matters more than it sounds is that our entire apparatus for stopping bad things assumes an author. Courts need a defendant. Elections need someone to vote out. Journalism needs a subject, campaigns need a target, and moral reasoning itself is built around agents who chose. Point all of that at a process with no author and it just slides off. You can’t sue a drift. You can’t vote out an incentive gradient. When someone asks who’s responsible for this and the honest answer is everyone slightly, the practical translation is nobody, and the practical consequence is that nothing happens.
Which is also why the public conversation keeps reaching for villains. It’s much easier to organize against a person than a structure, so the argument becomes about a handful of executives and their personalities. Some of them may well deserve it. But if every one of them were replaced tomorrow by someone thoughtful and cautious, the successors would face the same competitors, the same investors, and the same quarterly logic, and the outcome would move by a rounding error. Villains are a coping mechanism for a problem shaped like this. They give the story a protagonist so it can be told at all.
The steps have one more property worth naming, which is that they’re individually reversible and collectively not. Any single decision here could be undone. Rehire the junior. Cancel the subscription. Restore the manual process. Each one is genuinely a choice, and that’s not a rhetorical trick, it’s true. But undoing the aggregate would require undoing thousands of them at once, in different organizations, in different countries, against everyone’s local interest, all in the same quarter. The ratchet isn’t in any one tooth. It’s in the fact that the teeth only turn one way and there are so many of them.
Let me argue against myself, because this style of thinking has a failure mode and I’ve watched people fall into it. If nobody’s responsible, then nobody’s responsible, including me, and that’s a very comfortable place to end up. Structural explanations can become an excuse machine: I had no choice, the incentives made me, the system is the problem. That’s mostly nonsense at the individual level. The manager could hire the junior. The company could keep the fallback exercised. It costs something, and costing something is what a real choice feels like. The structure explains the average behavior, and average is not a person.
And structural traps do get escaped. It’s rare, it’s slow, and it always looks the same when it works: somebody changes the incentives rather than lecturing the people responding to them. Liability moves the calculation. Standards move it. Making one party bear a cost they were previously exporting moves it. That’s the entire toolkit, and this series argued in Act 1 that it exists and is being talked out of existence rather than found to be impossible.
Tonight’s exercise. Think of something in your own organization that everybody agrees is bad and that continues anyway. A process that wastes weeks, a rule everyone routes around, a quality nobody has time for. Now try to name the person who chose it. Really try, and notice you can’t, and notice that the reason isn’t secrecy. Then ask what would actually have to change for it to stop, and observe that your answer is about incentives rather than people. You now understand the AI situation better than most of what you’ll read about it, and tomorrow I’ll spend a whole post arguing that I’m wrong about all of it.