07 Growth Analytics
Vanity Metrics vs Real Signals
Not every number deserves attention.
Activity → signal → interpretation → decision
Activity
What's happening
Signal
What it means
Interpretation
Why it matters
Decision
What to do
Why this matters
Vanity metrics feel like progress while hiding the actual situation.
Vanity metrics are numbers that go up — but don't indicate whether the business is improving in ways that matter. Follower growth, total page views, email open rates, social impressions — these numbers can all increase while pipeline quality declines, trust decreases, and growth slows. They feel like signals. They're activity measures.
The danger of vanity metrics is not that they're inaccurate — it's that they're satisfying. A quarterly report showing strong vanity metric growth creates confidence that something is working. It makes hard questions feel unnecessary. It delays the recognition that the actual growth variables are moving in the wrong direction.
Real signals are different. They're often harder to collect, less immediately gratifying, and more directly connected to decisions. Inbound conversation quality, prospect understanding depth, referral conversion rate, sales cycle length relative to deal value — these signals are difficult to game and directly relevant to growth outcomes.
Founder reality
Signal quality questions worth asking in every growth review:
Are we measuring activity or are we measuring outcomes?
If these numbers stayed flat, would our business be in trouble?
Which metric, if it doubled, would definitely mean our business is growing?
Are any of our metrics going up while the business gets harder to grow?
What would we track if we could only track three things?
The last question is usually the most clarifying. Three metrics forces prioritisation — and prioritisation reveals what actually matters.
The signal quality framework
Distinguishing vanity metrics from real signals
The difference between a vanity metric and a real signal is its relationship to decisions. Real signals change what you do. Vanity metrics confirm what you're already doing.
01
Does it change a decision?
A real signal is one that, if it changed significantly, would cause you to do something differently. If a metric can double or halve without changing any decision, it's not a decision-quality signal — it's an activity measure. Filter every metric through this question.
02
Does it lead or lag?
Leading signals predict future outcomes. Lagging signals confirm past ones. Both have value — but leading signals are more useful for growth decisions because they allow course correction before outcomes are locked. Vanity metrics are almost always lagging and weakly correlated with outcomes.
03
Can it be gamed without real improvement?
If a metric can improve through activity that doesn't improve the underlying business, it's a vanity metric. Follower counts can increase through tactics that produce no trust. Page views can increase through content that creates no understanding. If it's gameable, be suspicious of it.
04
Does it connect to trust, understanding or pipeline?
The best growth signals connect directly to the conditions that produce growth: trust, understanding, and qualified demand. Metrics that don't connect to these conditions — however large the numbers — are unlikely to be real growth signals.
Common mistakes
01
Reporting vanity metrics in growth reviews
Vanity metrics in growth reviews create false confidence and crowd out discussion of real signals. Review meetings should be structured around decision-quality signals only.
02
Using vanity metrics to justify investment
Justifying channel investment with impressions and reach data produces continued investment in channels that may not be building trust or understanding.
03
Tracking too many metrics
More metrics produce more noise and less signal. Fewer, better-chosen metrics produce clearer decisions. Most companies track too many metrics — and therefore act on almost none of them.
04
Confusing correlation with causation in vanity metrics
A campaign that produces high impressions and is followed by pipeline growth feels causally linked. It may not be. Correlation between vanity metrics and outcomes is often coincidental.
Example scenario
A cybersecurity startup's monthly growth report shows impressive vanity metrics but the CEO is worried about slowing growth.
The vanity metric picture
Newsletter subscribers: up 40%. LinkedIn followers: up 25%. Website visits: up 30%. Blog post reads: up 35%. Every number is growing. The report looks strong. But qualified pipeline is flat and sales cycle length is increasing.
The signal audit
Inbound conversations from content: 2 per month (unchanged for 6 months). Prospect understanding rate (can describe core value before first call): 15%. Referral-introduced pipeline: declining. Community mention rate: unmeasured. The activity numbers are growing. The trust and understanding signals are not.
The metrics redesign
Remove follower count and raw page views from growth reports.
Add: inbound conversations attributed to specific content pieces.
Add: prospect pre-call understanding rate (measured via sales team feedback).
Add: content-to-conversation conversion rate by topic and format.
The outcome
New metrics immediately revealed that none of the high-performing vanity metric channels were producing trust signals. Investment shifted. Within four months, inbound conversation quality improved significantly. The vanity metrics had hidden the problem for over a year.
Takeaway
Track fewer metrics — but make sure they're real signals.
A small set of decision-quality signals produces better growth decisions than a large set of activity measures. The discipline of removing vanity metrics from growth reviews is uncomfortable — and almost always immediately clarifying.
Continue reading
The Consistency Problem