Alygn
← All articles

Vanity Metrics: Why Every Status Report Is Green and the Year Drifts

Vanity metrics count effort, not results. How to spot them, what to measure instead in every department, and what a status report should contain.

By Leslie Lee Fook 10 min read

Vanity metrics are numbers that rise whenever people are busy and say nothing about whether the company is getting where it said it would go. Emails sent, meetings held, reports filed, tickets touched. They fill a status report with green, which is exactly why a company can read twelve green reports in a row and still miss the year.

If that has happened to you, nobody lied. The reports measured what they were built to measure. They were built to measure the wrong thing.

The green report and the drifting year

Here is the shape of it. A leadership team reviews fourteen workstreams every month. Each one reports its activity and a red, amber or green rating chosen by the person running it. By September, eleven are green, three are amber, none are red. Revenue is 9% behind plan.

Every line on that report can be true at the same time as the revenue gap. Marketing did launch the campaign. Sales did hold forty discovery calls a week. The new onboarding process was documented, on time. What nobody wrote down, because nobody was asked, is whether any of it moved the number the year depended on.

That gap is not a reporting failure. It is a measurement failure that shows up in the reporting.

What makes a metric a vanity metric

A vanity metric is not a fake number. It is usually accurate, easy to collect and pleasant to look at. It fails on meaning, and you can catch it with three questions:

  1. Does it go up when people work harder, whether or not the work worked? Emails sent rises with effort. Replies that turned into meetings rises with results.
  2. Would anyone change a decision if it doubled or halved? If the answer is "we'd be pleased" or "we'd be worried" but nobody would move budget, people or priorities, the number is decoration.
  3. Can you compare it to something the strategy asked for? "Published 22 posts" has no target that came from the plan. "Qualified leads: 140 against 180" does.

A number that fails all three is a vanity metric. A number that fails one deserves a second look before it goes in front of the board.

Status updates report effort. KPIs report results.

The confusion usually starts with the status update. A status update answers "what did you do?" It is a reasonable question, and a manager running a team week to week needs the answer. A KPI answers a different question: "is the thing we need actually happening?"

The trouble begins when the first answer is presented as the second. Activity gets a color, the color gets rolled up, and a leadership team ends up governing the company on how hard everyone is working. We have written about the underlying distinction in the difference between activity and outcomes at work; the short version is that activity is what you spend and outcomes are what you get.

A KPI has three parts a status update usually lacks: a baseline (where it was), a target (where the strategy needs it to be) and an owner (one person who answers for it). Without those three, a number cannot be on or off track. It can only be up or down.

Vanity metrics and the outcome measures to use instead

Every department has its own favorite vanity metrics, and they are favorites for good reasons: they are visible, they are under the team's control and they always improve. The table below pairs the common ones with an outcome measure that answers the same question honestly.

Department Vanity metric Why it flatters Outcome measure instead
Sales Calls made, emails sent Rises with effort alone Qualified pipeline created; win rate on qualified deals
Marketing Impressions, posts published Cheap to increase Leads that reach a first sales conversation; cost per qualified lead
Customer success Check-in calls held Measures visits, not health Renewals closed on time; revenue retained from existing customers
Support Tickets closed Closing is not solving Issues resolved on first contact; reopen rate
Engineering Story points, commits Inflatable by estimate Releases customers use within 30 days; defects found by customers
People / HR Training hours, interviews held Counts the calendar Time for a new hire to reach full productivity; regretted departures
Finance Reports filed on time Compliance, not insight Days to close the month; forecast accuracy against actuals
Operations Process documents written, meetings held Paper is not throughput On-time delivery; cost per order or unit
Leadership team Initiatives launched Starting is not finishing Strategic priorities on track against their targets

Two notes on using this table. First, the outcome measure is harder to move, and that is the point: if it were easy, it would not tell you much. Second, the team may not fully control it. Support does not control the reopen rate alone, because a bad release reopens tickets. That is fine. A KPI the team strongly influences beats a vanity metric it fully controls.

Activity still belongs somewhere

None of this means throwing activity numbers away. Calls made, content published and interviews held are useful, as leading indicators: early signals you manage week to week because the outcome arrives too late to steer by. If qualified pipeline is the outcome, discovery calls held might be one of the things you watch to predict it.

The mistake is promoting the leading indicator to the KPI, or reporting it without the outcome it is meant to predict. Leading and lagging indicators covers how to pair them, and how to set a baseline and target so both mean something.

A useful test: if your activity number has gone up for three months and the outcome it is supposed to predict has not moved, the activity is not a leading indicator. It is a habit.

What a status report should contain instead

A good status report is shorter than the one you have now. For each KPI, four lines:

  1. The number against its target, and the baseline it started from.
  2. The trend since the last report: up, down or flat, with the figure.
  3. What changed, in one sentence. A cause, not a list of activities.
  4. What the owner needs, if anything. A decision, a person, a budget line.

Here is the same month written both ways.

The vanity version: "Marketing: sent 2,400 emails, published 9 posts, launched the autumn campaign, held 31 partner meetings. Status: green."

The KPI version: "Qualified leads: 140 against a target of 180 (baseline 120). Down from 155 last month. The partner webinar slipped three weeks, and it was expected to produce about 30 leads. Need: a decision on whether to move webinar budget to paid search for November."

The second version is less flattering and far more useful. A leadership team can act on it in the meeting. It also makes the color rating unnecessary: 140 against 180 is not green, and nobody has to argue about whether it is amber.

If a department cannot write the KPI version, that is the finding. It usually means the department was never given a number that came from the strategy, only a list of things to do.

Why green reports keep happening

Teams do not drift into vanity metrics by accident. A few conditions reliably produce them:

  • The owner grades their own work. When the person running a workstream chooses its color, green is the rational choice until the evidence is overwhelming.
  • Amber is treated as failure. If an honest amber earns a grilling, people learn to report effort, which is always green, instead of results, which sometimes are not.
  • There is no target. Without a number the strategy asked for, there is nothing to be behind. Activity fills the space.
  • The report is built from what is easy to collect. Systems count emails and tickets automatically. Nobody has to count outcomes, so nobody does.

This is the same pattern behind why teams are busy but not productive: when the measure is effort, effort is what grows. Everyone works hard. The company does not get where it was going.

How to retire vanity metrics without a revolt

People defend vanity metrics because those metrics have been defending them. Take them away abruptly and you get resistance. A gentler sequence works better.

  1. List everything each department reports. All of it, in one document. Most leadership teams are surprised by the length.
  2. Ask the doubling question of each line. "If this doubled next month, what would we do differently?" Lines with no answer are candidates for removal.
  3. Ask what the strategy needs from the department. In one sentence, before any numbers. Then turn that sentence into a measure with a baseline, a target and an owner. Our guide on how to create KPIs walks through doing that from the strategy you already have.
  4. Keep the useful activity numbers as leading indicators, reported underneath the outcome they predict, never instead of it.
  5. Run both for one quarter. Report the old activity numbers and the new KPI side by side. By the end of the quarter, most teams stop reading the old ones on their own.

The order matters. Step 3 comes before step 4 because a leading indicator only makes sense once you know what it is leading to. Picking activity measures first is how vanity metrics got onto the report in the first place.

Frequently asked questions

What are vanity metrics?

Vanity metrics are numbers that increase with effort or attention but do not show whether the organization is achieving its goals. Common examples are emails sent, meetings held, reports filed, impressions and tickets closed. They are usually accurate and easy to collect, which is why they end up in status reports.

Are all activity metrics vanity metrics?

No. An activity metric becomes a vanity metric when it is reported as the result. Activity numbers are useful as leading indicators, reported beneath the outcome they are meant to predict. If the activity rises for months and the outcome does not move, drop it.

What should a status report contain?

For each KPI: the current number against its target and baseline, the trend since the last report, one sentence on what changed, and what the owner needs. That format replaces color ratings with figures a leadership team can act on in the meeting.

How do you replace a vanity metric with a KPI?

Start with what the strategy needs from the team, in one sentence. Turn that sentence into a measure with a baseline, a target and one named owner. Keep the old activity number only if it reliably predicts the new measure, and report the two side by side for a quarter.

Why is every project on our status report green?

Usually because the people running the work choose their own color, the report measures activity rather than results, and there is no target to be behind. Activity is always green. Replace the colors with each KPI's number against its target and the drift becomes visible months earlier.

Planning next year?

Measure What Moves is a free, live working session for CEOs and managing directors. Bring the strategy you already have and leave with KPIs for your organization and every department, each with a named owner.

Claim a free seat

Keep reading