Scaling AI FinOps | Lesson 25: Field Notes from the Canopy

The second dry season ended with everybody in the Canopy, and a number on the table that was larger than the one that started all of this.

That is the ending, and I want to be honest that it is the ending, because the version where the bill goes down is a more satisfying story and it is not the one that happens.

The jungle was spending more than it had two years earlier. Considerably more. It was also serving four times the volume of work at a fraction of the cost per unit, retiring things routinely, funding capabilities that continued rather than projects that ended, and able to say, for every part of that number, what it had bought.

The Crow read the pack. It contained the ledger, the variance between claimed and realized, the decay assumptions with their review dates, the unit economics by capability, and a list of four things that had been switched off since the last review.

She signed it.

The Crocodile, who had spent two years opening one eye to say something correct, read it through and found nothing to correct. So he did not open his eye at all, which in this jungle is the highest compliment available.

The Fox noticed. Nobody else did.

If you are starting here

A fair number of people will read this post first, and it is written to work on its own.

The argument of the whole series is one sentence. AI is the first major category of enterprise spend where the cost number, by itself, tells you nothing about whether the money was well spent, because growth in spend is what success looks like and it is also what a runaway failure looks like, and the two are indistinguishable on a bill.

Which means the question people reach for, are we paying too much, cannot be answered. It is not difficult. It is malformed. The answerable question is whether you are getting enough for what you pay, and that requires a denominator, and almost nobody has one.

Everything below follows from that.

The twenty five

The Jungle Floor

  1. A cloud bill tells you what you bought. An AI bill tells you what you did.
  2. A disagreement you cannot resolve is usually a translation failure. Agree what the number counts before you argue about it.
  3. Inference is the layer you budgeted and rarely the layer that hurts.
  4. Shadow AI is not defiance, it is an unfunded requirement with a credit card.
  5. A hundred experiments is not coverage. It is the same experiment funded a hundred times by people who have not met.

Learning to Count

  1. Count what was accepted, not what was produced.
  2. Decide who funds the shared foundation before you decide how to split the water.
  3. Time saved is not money saved until somebody does something specific with the time.
  4. You cannot measure a change you did not measure before.
  5. Write down what you promised, and never edit the entry.

Architecture Is a Financial Decision

  1. Two cost curves, not two products. The only questions are where they cross and how much you trust the volume.
  2. Most of what you send to the cleverest animal does not need the cleverest animal.
  3. You are billed for the question as well as the answer, and the question is usually bigger.
  4. Price the constraint as a design input rather than arguing about it as a tax.
  5. Autonomy is where you stop buying answers and start buying attempts. Budget the tail, not the average.

The Operating Model

  1. A project is funded to end and a capability is funded to continue. Only one gets cheaper the twentieth time.
  2. Fund persistently, reallocate quarterly, and cut something visible in the first year.
  3. Cost and quality cannot be governed in separate rooms.
  4. A ceiling lands hardest on whoever is using the thing most.
  5. A commitment locks your volume, your price, and quietly your capability tier.

The Long Game

  1. Nothing you optimized stays optimized.
  2. Write the sunset criteria at launch, while nobody is attached to it yet.
  3. Assurance is what you pay for the right to change anything quickly.
  4. Spend on literacy rather than on tooling that answers questions nobody knows how to ask.
  5. You cannot manage what you cannot divide.

Four stages

Deliberately behavioral rather than tooling-based, because tooling maturity and actual maturity are only loosely related and the second one is what matters.

Blind. Spend visible in aggregate only. No denominator, no allocation, no acceptance data. Every discussion is anecdote and gets resolved by seniority. Most organizations are here and do not know it, because they have a dashboard.

Attributed. Spend allocated to teams and capabilities. Denominators defined and dated. Showback running. Discussions become factual. Decisions are still slow, because the evidence exists but nothing is built to act on it.

Managed. Unit economics trending. Value ledger live and append-only. Reallocation on a published cadence with real authority. Optimization owned by engineering. The organization can answer whether it is getting enough for what it pays, which is the threshold question.

Compounding. Cost per unit falling while volume grows. Retirement happening routinely rather than during reorganizations. Architecture decisions made on unit economics as a matter of habit. Rare, and realistic within about three years for an organization that starts properly.

Where you actually are

Five questions. Ten minutes in a leadership meeting. Answer honestly rather than aspirationally, which is harder than it sounds.

  1. Can anyone tell you last month’s AI spend broken down by business purpose, not by vendor or model?
  2. For your largest capability, what is the cost per accepted unit of work, and who owns that number?
  3. When was the baseline for your largest benefit claim captured, and was it before or after go-live?
  4. What did you switch off this year?
  5. Are cost and quality reviewed in the same meeting, by the same people?

Three or more no answers puts you at Blind, whatever your tooling suggests. That is not an indictment. It is where nearly everybody starts, and the jungle in Lesson 1 could not have answered any of the five.

Ninety days

If you want to start on Monday, this is the order I would do it in. Each phase has an owner and produces an artifact, because phases without artifacts are intentions.

Days 1 to 30. Find out where you are.

  • Instrument at request level. Team, use case, business purpose on every call. Three weeks of work now, three quarters later. Owner: engineering. Artifact: tagged traffic.
  • Pick one denominator for one capability, and let the people who own it choose it. Owner: the capability owner. Artifact: one dated sentence.
  • Count the pilots and multiply by an honest fully loaded fixed cost. Owner: finance. Artifact: one number.

Days 31 to 60. Build the spine.

  • Publish the allocation rule before you publish any allocated number. Owner: finance. Artifact: one page.
  • Stand up the value ledger, append-only, in a spreadsheet. Owner: finance. Artifact: the ledger.
  • Capture a baseline before anything else ships, and capture the staggered rollout data you are already generating. Owner: the business. Artifact: a dated measurement.

Days 61 to 90. Prove it is real.

  • Run the first review with cost and quality in the same room. Owner: whoever arbitrates. Artifact: decisions.
  • Cut one thing, visibly. Owner: the portfolio owner. Artifact: a retirement.
  • Publish claimed against realized, including the gap. Owner: finance. Artifact: the variance.

Nine items. None of them require a platform purchase. The most expensive is three weeks of engineering time and the most valuable is probably the last one.

The one thing

If all of this reduces to a single argument, it is this.

AI FinOps is not a cost discipline. It is a measurement discipline that produces cost outcomes, and the distinction is not academic. An organization that treats it as cost control will cut things, quickly and confidently, and will cut the wrong ones, because without a denominator every reduction looks like a saving and the panic cap in Lesson 19 looks like a win for five weeks.

An organization that treats it as measurement will spend a slower and less satisfying first year building a denominator, a ledger, a baseline and an honest conversion path. And then it will make cost decisions that are correct, repeatedly, because it can see what it is doing.

The whole thing is the patient work of finding an honest denominator and then defending it against everybody who would prefer a flattering one. That is it. Get it right and the cost questions start answering themselves. Get it wrong and you will cut the wrong things, quickly, with great confidence, and you will not find out for two years.

Jungle Lesson 25

Twenty four lessons reduce to one. You cannot manage what you cannot divide, and the whole discipline is the patient work of finding an honest denominator and defending it against everyone who would prefer a flattering one.

What comes next

That is the series. Twenty five lessons, two dry seasons, one jungle, and a cast who were all right about something and wrong about something else, which is the only kind of cast worth writing.

I said in Lesson 23 that there was a larger subject sitting underneath all of this, and that it did not fit in a Field Kit. It has been visible at the edge of nearly every one of these posts. The Tortoise’s list. The version that changed behavior without warning. The workflow with no owner sitting inside a month end close. The question of who signed off on a system nobody entirely understands.

Cost is the tractable half of enterprise AI. Governance is the half that decides whether any of it survives contact with a serious question, and it is where I am going next, at proper length, starting next week.

Thank you for reading this one. The jungle is quieter than it was.

If you take one thing from twenty five posts, take the denominator. Everything else in this series is an elaboration of it, and an organization that has one is playing a fundamentally different game from an organization that does not, regardless of what either of them has bought.

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.