Intro.
#Vanity Metrics vs. Real Metrics — the One Question That Separates Them
A vanity metric is a number that only goes up and never tells you what to do next. Cumulative downloads, followers, total pageviews — these almost always trend upward. That's reassuring, but it doesn't tell you what to fix. A real metric is the opposite. When it moves, it points you to what to touch next.
| Category | Vanity metric (avoid) | Real metric (watch) |
|---|
| Users | Cumulative signups, cumulative downloads | Weekly active users, return-visit rate |
| Social | Follower count, total likes | Signup conversion rate from traffic |
| Traffic | Total pageviews | Core-action completion rate |
| Revenue | Total transaction volume alone | Paid conversion rate, average order value, repeat purchase rate |
One question separates them: "if this number dropped, what would I change tomorrow?" If there's an answer, it's a real metric; if not, it's vanity. A rate or a metric measured over a fixed period (conversion rate, weekly figures) is almost always more useful than a running total.
주의
A cumulative number keeps climbing even as a business is declining. Yesterday's running total hides today's actual health. Get in the habit of looking at the same metric "this week" instead of "cumulative."
02
#How to Pick a Single North Star Metric
A North Star metric compresses "how many times our product actually delivered value to a customer" into a single number. It's closer to the size of value delivered than to revenue — because revenue is the result that follows once value is delivered well.
There are three steps to picking one: write your core value in one sentence, choose the user action that lets you say the value was "delivered once," and count that action over a fixed period as your North Star.
| Industry | Core value in one line | Sample North Star metric |
|---|
| SaaS (work tool) | Automatically finishes a repetitive task for you | Weekly users of the core feature |
| Marketplace | Connects buyers and sellers and closes the transaction | Weekly completed transactions |
| Content / media | Gets people to consume the content they need, all the way through | Weekly sessions with full read-through or watch-through |
TIP
There should be only one North Star. Chasing two or three at once blurs which direction the team is rowing. Keep supporting metrics, but fix a single North Star for the whole company.
That said, check whether your North Star actually aligns with user value. Pick "time on page" as your North Star and you end up rewarding a design that deliberately makes people wander and get lost. Choose an action that moves in the same direction as value — something like "how many times a user reached the outcome they wanted, quickly."
03
#The Funnel That Supports Your North Star — Stage-by-Stage Tracking Events
Looking at your North Star alone won't tell you why it went up or down. That's why you track a staged funnel underneath it. The framework commonly used at early-stage startups has five stages.
| Stage | In plain terms | Sample events to track |
|---|
| Acquisition | How do people find out and come in | Visits, signup starts |
| Activation | Did they experience the value once, on their first visit | Onboarding completed, first core action completed |
| Retention | Do they come back | Return visits at day 7 / day 30, weekly repeat usage |
| Revenue | Do they pay | Paid conversion, payment completed |
| Referral | Do they recommend it to others | Invite sent, share clicked |
Early on, don't try to measure all five stages at once. Usually the first three — acquisition, activation, retention — are the fastest way to learn whether the product actually works. Revenue and referral can wait until those first three are healthy.
TIP
At each stage, look at "what share of people who came in made it to the next stage." Out of 100 signups, how many reached their first core action — that's your activation rate. Whichever stage has the lowest conversion rate is exactly what to fix next.
04
#Why Activation (the Aha Moment) Should Be Your First Priority
Of the five stages, activation is what early founders need to nail down first and most clearly. Activation is the moment a user first feels "ah, this is why I use this product." Commonly called the "aha moment." Users who cross this line and users who don't diverge sharply in retention afterward.
If your definition of activation is fuzzy, the entire funnel downstream wobbles. Mistake "signup" for "activation," and you'll pour money into marketing that only drives signups without noticing that nobody comes back. Activation needs a narrow definition: "the action where value was actually experienced."
- Find the "common first action" among users who stick around — look at what your longest-retained users did in their first week.
- Define that action as a one-line statement with a number in it — e.g., "created 1 project and invited 1 teammate within the first 3 days."
- Compare retention between the group that did that action and the group that didn't — a big gap means that's your real aha moment.
- Instrument that definition as an event and track activation rate weekly — keep the one-line number fixed and stable.
체크
A team that has pinned down its activation action in numbers can answer "how far do we need to fix onboarding" with data. A team that treats "signup = success" instead is stuck guessing at the same question.
05
#A Measurement Setup Checklist — Start Light
You don't need to install anything elaborate up front. Early on, one lightweight, free-to-start analytics tool is plenty. What matters is writing down, on paper, which events go where — before you pick a tool. Event design comes before tool selection.
- Write your one-line North Star metric at the top of a document — the whole team should see the same sentence.
- Pick three of the five funnel stages to track right now (acquisition, activation, retention).
- Define 1–2 core events per stage and standardize their names — e.g., sign_up, activated, return_d7.
- Sharpen the activation event once more into a "definition with a number in it."
- Attach one lightweight analytics tool and instrument just those events first.
- Update a stage-by-stage conversion table weekly, and pick only the single weakest cell as next week's task.
주의
Instrument 30 events at once and nobody looks at any of them. Start with 1 North Star metric plus 5 or fewer core events, and only add more once the habit of actually looking is established. A metric nobody watches is the same as not measuring it at all.
The North Star and funnel you set up this way carry straight over into the traction and growth-strategy sections of your business plan. Reviewers read a team's grasp of the business in "what numbers you track, and why those numbers." A plan that strings its logic together around one North Star reads very differently from one that just lists vanity metrics.
CTA
Experience an OpenSeed AI review yourself. 15 AI agents collaborate to analyze your business plan, delivering not just a score but a capability-by-capability diagnosis, supporting evidence, and concrete recommendations for improvement.
Summary.
#Frequently Asked Questions (FAQ)
Q. I haven't launched yet, so I have no data to measure. Do I still need to pick a North Star?
A. Yes. Writing down what your North Star will be and how you'll define activation before launch means you instrument the right events from day one. Decide after launch, and you throw away your early data entirely.
Q. Can't revenue be my North Star?
A. Once you're further along in growth, revenue growth rate can become a North Star. But early on, while you're still validating product-market fit, "how many times value was delivered" gives you a signal faster. Revenue is a lagging result of accumulated value delivery, so it shows change late.
Q. Do I have to split the funnel into exactly five stages?
A. No. Five is just a starting point. Feel free to merge or split stages depending on your product. What matters is the mindset — look at conversion rates between stages and find the weakest one — not the number of stages itself.
Q. Activation rate is low. What should I look at first?
A. Suspect the first screen after signup (onboarding) first. Getting new users quickly to the common action your longest-retained users take in week one is the most direct way to raise activation rate.
Does the Metrics Logic in Your Business Plan Actually Hold Up?
OpenSeed's AI review examines your North Star, funnel, and traction logic from 15 agent perspectives, with supporting evidence and concrete recommendations for improvement.
🔒 Free during beta · your submission isn't saved
Start Free AI Feedback →