The Danger of the Vanity Metric

The tell of a vanity metric is that it only ever increases and always feels good: total signups, cumulative downloads, all-time users. These numbers cannot go down, so they always look like progress, which is exactly why they are dangerous. They provide the feeling of success without the substance.

A useful metric can move in both directions and forces a response when it moves the wrong way. If a number can only make you feel good, it is probably not telling you anything actionable.

The opposite of a vanity metric is an actionable one: a number that, when it changes, tells you to do something specific. Conversion rate, churn, cost per acquisition — these can worsen, and when they do they demand a response. That is what makes them worth tracking.

Before adding any metric to a dashboard, ask what you would do differently if it moved. If the answer is nothing, you have found a vanity metric, however impressive it looks in a board deck.

The real harm of vanity metrics is not that they are useless but that they actively conceal problems. Rising cumulative signups can mask a collapsing conversion rate; growing total users can hide accelerating churn. The comforting number papers over the alarming one.

Discipline yourself and your team to lead with the metrics that can hurt. A culture that celebrates only the numbers that always rise is a culture flying blind toward the numbers that actually matter.