The evaluation closes, the contract gets filed, the working group dissolves, and somebody sends a thank you note. Seven months later a different part of the organization starts the same process from nothing.
Nine months, then seven weeks
Composite from a few organizations now several purchases deep: a construction and infrastructure group, on its fourth evaluation of this kind in three years.
Illustratively, the first took about nine months from mandate to signature. The fourth took roughly seven weeks, for a purchase of comparable size and rather more complexity.
The software had not got simpler. What had changed was that the fourth evaluation started with things the first three had produced.
A standing question set, the same one every time. A habit of measuring the baseline before anyone contacted a vendor. A list of the internal groups who could stop a project, with their actual lead times next to their names, updated after each purchase. A rough template for estimating switching cost. And a record of what they had declined to buy, with the reason.
That last one is the rarest. Most organizations keep a careful record of what they bought and no record at all of what they turned down, so the same product gets evaluated twice by different teams and the same objection gets rediscovered from scratch, at full price both times.
What compounds
Four things, and none of them require a center of excellence, a new function, or anybody’s headcount.
Questions rather than templates. A template gets filled in. A question gets answered, and the answers are what you actually needed. The demo requests, the reference questions, the diligence conversation, the pricing question about what moves when usage doubles. Twenty questions on one page, refined a little each time.
The measurement habit. Baseline before vendors. It takes a week and it is the difference between a benefits review that confirms your judgment and one that finds nothing to look at.
The stopper map with lead times. Not a stakeholder list. The groups who can quietly cost you months, and how many months each of them currently costs. This information already exists inside your organization, distributed across the memories of people who have been burned, and writing it down once converts it into something the next team inherits.
The decision log, including the noes. What you bought, what you declined, and why. Two paragraphs each. Kept somewhere findable by someone who does not know it exists.
Four documents, one owner, no budget. That is the whole apparatus.
The asymmetry you can actually close
This series opened with three asymmetries between the buyer and the seller. They know your process because they run it constantly. They know the market because they are in it every day. And they can wait longer than your sponsor’s attention lasts.
Two of those are not available to you. You will never have their pricing data, and you cannot out-wait them on any individual deal.
The third one is entirely yours. Their advantage is repetition, and repetition is a thing you can build. Not by buying more often, which would be a strange goal, but by making each purchase leave something behind that the next one starts from.
An organization on its fourth evaluation with none of that is on its first evaluation, four times. An organization that kept those four documents is genuinely, measurably better at this than it was, and it closed the only gap it was ever able to close.
You will still get some wrong
I have done most of what is in these fifteen lessons, and I have also skipped most of it, usually under time pressure, and some of those purchases were fine. Process is not a guarantee and anyone selling it as one is selling something.
What changes is the character of the mistakes. Without any of this, you make the same three errors repeatedly: no defined no, no measured baseline, no idea who could stop you. With it, you make new and more interesting errors, about things that were genuinely hard to see.
That is a reasonable definition of getting better at something, and it is the realistic version of what this series is offering. Not better outcomes every time. Failures that at least have not happened before.
One thing to do differently
When this evaluation closes, before the group disbands, spend two hours writing down what you would tell the person who runs the next one.
What you would ask earlier. Who you would have gone to see in week one. What the vendor said that turned out to matter. What you declined and why.
Then put it somewhere they will find it without knowing to look. That document is the capability. Everything else in this series is just a description of what tends to be written in it.