AI adoption

How to measure AI adoption when license counts lie

Sooner or later a senior leader asks the question every enablement lead dreads, and it is not hostile. It is reasonable. "How is the AI rollout going?"

You open the dashboard. Eighty percent of licenses activated. Weekly active users trending up. Thousands of messages sent. It looks like progress, and you already know, standing there, that it answers a question nobody asked. None of those numbers tell you whether a single person does their actual job better than they did six months ago. They tell you the tool is being touched.

This is the measurement trap that catches most AI programs. The things that are easy to count are the things that mean the least, and the thing that matters, whether a better way of working has actually taken hold, does not show up on the license report at all.

Why license counts lie

A license count measures access. Nothing more. It is the number of people who could use the tool, dressed up as the number of people getting value from it.

The gap between those two is enormous and invisible. Someone activates their seat in the first week because IT sent an email, uses it twice, and never opens it again. On the dashboard, they are an activated license forever. Multiply that by a few thousand and you have a chart that climbs reassuringly while adoption, the real kind, flatlines.

Weekly active users is a small step better, because at least it counts people who showed up. But showing up is not adoption either. A person can open an AI tool every day, type a mediocre prompt, get a mediocre result, and call it done. High activity, zero improvement in how the work gets done. The number goes up. The work does not get better.

Why usage stats are better, and still wrong

The next instinct is to measure usage more precisely. Count the prompts. Rank the most-used ones. Surface the popular templates.

This is closer, and it still measures the wrong thing, for two reasons.

First, raw usage surfaces the most common prompt, not the best one. The prompt everyone reaches for might be popular because it was the first one posted in a channel, not because it is any good. Volume is a measure of habit and visibility, not quality.

Second, and this is the subtle one, usage counts include the author using their own work. The person who wrote a prompt uses it constantly, of course they do, it is theirs. If you count that, you are measuring enthusiasm for one's own idea, which every idea has. It tells you nothing about whether anyone else found it worth adopting.

The fix for both is the same, and it is the hinge this whole piece turns on: stop counting how much a prompt is used, and start counting how many people other than its author chose to use it. That single shift, from usage to reuse-by-others, is the difference between measuring activity and measuring adoption.

The four measures that actually mean adoption

Once you accept that adoption is about a way of working spreading beyond the person who invented it, four measures fall out naturally. None of them come from a license dashboard.

Reuse by non-authors. For any given prompt or practice, how many distinct people who did not write it chose to use it? This is the quality signal. A prompt three colleagues independently adopted is worth more than one used two hundred times by its author. It is also how good practice gets discovered without anyone being asked to nominate their own work.

Spread. When a practice does get adopted, does it stay inside the group that created it, or does it reach people doing that kind of work elsewhere in the organization? A prompt copied fifty times inside its origin team has not spread. One copied twenty times across four departments has. Spread is the measure that proves a practice escaped its origin, which is the entire thing you are trying to make happen. It is also the measure most programs cannot see at all, because they are watching the circulation gap from the wrong side.

Contribution rate. What share of active people put something in, rather than only taking things out? This tells you whether the program is self-sustaining or whether it only moves when you push it. A program where a central team writes everything is a program with a single point of failure, and its own founder is the failure point.

Coverage. Which kinds of work have an agreed, standard way of doing them, and which are still ad hoc? Mapped by the kind of work people do, this is the map of where AI has and has not landed. It is also the one an executive actually wants, because it turns "how is adoption going" into a picture with named gaps instead of a single ambiguous percentage.

How to start reading these without new tooling

You do not need to buy anything to begin. You need to change what you look at.

  • Watch reuse, not activation. Pick one prompt or template that has been shared. Ask, honestly, whether anyone who did not write it has actually adopted it. If you cannot tell, that is itself the finding: you have no visibility into the only thing that matters.
  • Look for spread by asking a specific question. Not "is this being used" but "is this being used by people outside the group that made it." If the answer is always no, you do not have an adoption problem, you have a circulation problem, and it has a different fix.
  • Count contributors, not just users. Over the last month, how many people outside your core team added something worth reusing? Make that number, not license count, the one you report.
  • Name the gaps. List the recurring kinds of work in your organization and mark which have an agreed approach. The blanks are your worklist, and they are more useful than any percentage.

What the number is really for

The reason to measure adoption correctly is not tidiness. It is that the enablement lead who can show where a standard way of working landed and where it has not is in a completely different conversation with leadership than the one holding a license-activation chart.

One is defending a program with activity metrics that a skeptical CFO can wave away in a sentence. The other is showing evidence that a practice spread across the organization on its own. The measures are what make the second conversation possible, and none of them are the ones your tool vendor put on the default dashboard.

If you want a fast read on where your own program sits across these dimensions, the maturity assessment scores you on all four in about three minutes. But the more important move is the mindset: adoption is not how many people have the tool. It is whether a better way of working reached the people who do that work, and whether you can prove it.

Where does your program stand?

Most AI enablement stalls in the same place. The maturity assessment tells you where yours is in twelve questions, with no sign-up and no email to see your result.

← All field notes