In Practice: AI in the Enterprise | Day 62: Decision Authority in a Distributed Enterprise: The Coordination Problem Nobody Solved

There’s a moment in every large organization when the conversation about AI governance hits a wall.

It happens in the architecture review. Someone asks: “Who decides whether this model gets deployed?”

And the answer is always the same: “Depends. If it’s strategic, corporate. If it’s tactical, the team. If it crosses business units, we need alignment. If it’s in production, the data team has final say. If it’s high-risk, maybe compliance. If the model is too slow, maybe the vendor partnership office has opinions.”

What you’ve just heard is not a governance framework. It’s a coordination problem nobody solved.

Why Centralization Fails

The traditional answer is to centralize. Create an AI governance committee. All decisions flow up. The committee reviews. The committee approves or rejects. Governance at last.

This works great on a spreadsheet.

In reality: The committee meets monthly. Your teams move weekly. Half the models in production never went through the committee because they were too small to seem strategic when they were created, then grew anyway. The committee is backed up for three months. So people either wait and lose velocity, or they make small decisions that quietly become big, and the committee never actually reviews them.

Centralization doesn’t scale past about 50 to 100 AI projects. After that, the bottleneck becomes so obvious that people start working around it.

Why Decentralization Fails

The alternative answer is: Push authority down. Let teams decide. Create a framework of principles and let teams operate within it.

This works great in theory.

In reality: Different teams interpret the principles differently. One team thinks “high-risk” means “could affect accuracy.” Another thinks it means “could affect compliance.” One team implements change management. Another team says that’s unnecessary overhead. You end up with 20 versions of governance, all of them technically within the “framework.”

When something goes wrong, you don’t have coordination. You have finger-pointing.

Decentralization doesn’t work past about 20 to 30 AI projects. After that, the inconsistency becomes costly.

The Real Problem

The problem isn’t centralization vs. decentralization. The problem is that you’ve been asked to solve this before you actually needed to.

In a startup, you centralize. You have five models. Everyone knows them. The CEO approves changes. It works fine.

In a growth-stage company, you start decentralizing. You have fifty models. Teams own their own model performance. You set principles. Most things work.

In an enterprise, you realize: You have five hundred models. Fifty business units. Multiple geographies. Different regulatory requirements. Your principle-based decentralization has splintered into disconnected fiefdoms. Your centralization was a bottleneck even back when you had a hundred models. Neither works.

You need a third thing: structured coordination.

What Structured Coordination Looks Like

The key insight is that different decisions need different authority levels based on impact and reversibility, not based on size or strategic importance.

Here’s a decision framework:

Low-impact, reversible decisions (a model deployed to a small segment, easy to turn off): Delegate to the team. Notify the committee. No approval needed.

Medium-impact, partially reversible decisions (a model affecting a customer-facing system, costs money to revert): Require approval. But streamlined approval. One person, not a committee. Decision in 48 hours, not 30 days. Pre-vetted for compliance and technical soundness.

High-impact, irreversible decisions (a model affecting high-stakes customer outcomes, regulatory exposure, major infrastructure change): Full committee review. All stakeholders. Same process as a major capital investment.

Cross-boundary decisions (a model that affects another team, another geography, or shared infrastructure): Fast committee, smaller than the full review. Just the stakeholders with skin in the game.

The framework is simple. The power is in the rigor.

The Mechanism

Most organizations don’t have the rigor. They say “request approval from the team” without defining what approval means, how long it takes, or who has veto power.

Structured coordination requires:

  1. Clear decision criteria. “High-impact” is defined by: customer impact (how many users), financial exposure (what’s at stake), reversibility (can we turn this off), compliance exposure (does this touch regulated data), and integration (does this depend on other systems).

  2. Clear decision authority. For low-impact: team lead can decide. For medium-impact: one designated technical reviewer and one compliance reviewer, parallel review, 48-hour turnaround. For high-impact: full committee with defined attendees. For cross-boundary: structured 1:1 reviews with affected teams before the main committee meeting.

  3. Clear escalation paths. If a team disagrees with a rejection, what happens? Can they escalate? To whom? What’s the standard?

  4. Clear decision documentation. Not for compliance theater. For learning. So that in six months, when you’re wondering why the model is designed this way, you can read the original decision. So that when the same question comes up for the next model, you have precedent.

What This Costs

Structured coordination sounds bureaucratic. It is. It requires discipline. It requires people to actually follow a process instead of going around it.

The cost is in the overhead of documentation, in the time spent on 48-hour reviews, in the occasional project that feels delayed because it needed stakeholder alignment.

The cost is real. Budget for it. Make it part of your model development timeline.

What This Prevents

The benefit is that you stop making the same decisions five times with five different answers. You stop discovering after the fact that a team deployed something that violates a principle that everyone agreed to. You stop having the conversation about “but we’re different, these rules don’t apply to us.”

Most importantly: You stop having decision authority become a shadow power structure.

In organizations without structured coordination, the real decision authority isn’t in the official governance committee. It’s in whoever can most effectively argue, or whoever has the most political capital, or whoever is willing to most aggressively work around the system. Those things have nothing to do with making good AI governance decisions.

Structured coordination moves decision authority back to criteria. Not perfect criteria. But criteria. And criteria-based decisions are harder to dismiss and easier to defend.

Why This Matters

The distributed enterprise doesn’t have a single center. It has multiple centers. The question is not “who decides,” but “how do we decide consistently when decisions happen everywhere.”

Centralization and decentralization are both attempts to dodge this question. Structured coordination actually answers it.

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.