All posts

buildpurdue blog

Should You Scale Acquisition Before You Understand Retention?

A practical test for deciding whether to spend more on acquisition before you know which users find lasting value in your product.

By BuildPurdue Team7 min read

More signups can hide a product problem. Before you increase paid acquisition, add another channel, or hire around growth, check whether some users are returning because the product keeps solving a problem for them. You do not need a perfect retention curve. You do need a defined repeat-use event, a cohort you can observe, and a reason to believe more traffic will produce more of the users you want.

Key takeaways

  • Define what “coming back” means for your product before calculating retention.
  • Compare cohorts by acquisition source and behavior, not only in aggregate.
  • Use early actions as clues about retention, then test whether changing them improves later behavior.
  • Keep acquisition small and measurable until you can explain who stays and why.

What decision are you actually making?

“Should we grow?” is too broad to guide a budget. Write down the specific decision first:

We will spend $___ or ___ hours on ___ acquisition channel for ___ weeks if users from that channel reach ___ value event and return at the expected usage interval.

The condition matters because acquisition and retention answer different questions. Acquisition tells you whether people enter the funnel. Retention tells you whether the product continues to matter after they arrive. In a Y Combinator discussion of growth teams, Dan Hockenmaier warns against heavyweight acquisition before a company has cohorts whose retention levels out. That is a useful readiness test, not a universal percentage target.

If you cannot fill in the value event or the usage interval, you are not ready to compare channels. You are still deciding what value means.

Define retention around a real product behavior

Logging in is often too weak. A user may open an app from habit, curiosity, or an email without getting the result they wanted. Choose an event that represents useful progress: a team sends a report, a buyer completes a reorder, or a learner finishes a practice set.

Your event should answer three questions:

  • What action starts the observation period?
  • What later action counts as a return?
  • How often would a satisfied user reasonably repeat it?

Amplitude’s retention documentation describes retention as the time between a starting event and a return event, with the usage interval tied to daily, weekly, or monthly behavior. The tool is less important than the discipline. A weekly workflow should not be judged by a daily return target, and a one-time transaction may need a different measure entirely.

Write the definition in plain language before you touch a dashboard. For example: “A retained customer is one who completes a second team report within 14 days of the first.” If the sentence sounds arbitrary, interview a few users and learn how the job actually recurs.

Compare cohorts before you buy more traffic

An overall retention number can blend together users with very different reasons for signing up. Start with a simple table:

CohortUsersReached value eventReturned in normal intervalAcquisition cost or effort
Referral
Founder-led outreach
Content or search
Paid test

Use the same starting event, return event, observation window, and user definition for each row. A cohort is not useful if one channel gets counted after seven days and another after 30.

Amplitude’s product analysis toolkit recommends looking at retention by lifecycle and behavioral cohorts, such as users who completed a particular action. Mixpanel’s retention primer similarly describes a three-part process: define retention, establish a baseline over time, and use cohorts to investigate what may be associated with longer retention. That last step is where the useful questions begin.

Ask:

  • Which source brings people who reach the value event fastest?
  • Which source brings people who return at the product’s natural interval?
  • Do users who perform a specific action retain at a higher rate?
  • Are the differences large enough to matter, or are the cohorts too small to interpret?

Do not treat a correlation as proof that the action causes retention. It gives you a hypothesis to test.

Use early behavior as a diagnostic, not a promise

Suppose users who invite a teammate return more often. You now have at least three possibilities:

  1. The invitation creates genuine shared value.
  2. More committed users are simply more likely to invite someone.
  3. The two actions are both caused by a third factor, such as a particular customer type.

The next step is not to force every new user to invite a teammate. Talk to users in both groups. Find out what they were trying to accomplish, what blocked them, and whether the product would still be useful without the action.

Then run a bounded product test. Make the invitation easier for a defined group, or offer a clear reason to use it, and compare the result with the existing flow. The outcome you care about is later use of the value event, not clicks on the new button. The YC discussion above makes the same distinction between finding metrics that correlate with retention and experimenting to learn whether an intervention changes the result.

When is more acquisition reasonable?

Scale gradually when all of these are true:

  • You can describe the retained user in behavioral terms.
  • At least one cohort has enough follow-up time to show a repeat pattern.
  • You know the channel, audience, or message that produced that cohort.
  • The product can handle more users without a manual service burden that breaks the economics.
  • You have one leading measure to watch and one stop condition.

The last two points protect you from a false win. A channel can produce attractive signups while creating support work, low-quality accounts, or a product experience your team cannot maintain. Growth is only useful if the new users reach value at a cost and pace you can support.

Keep the first test narrow. Choose one source, one audience, one offer, and one observation window. Record spend, signups, value-event completion, repeat use, and notable qualitative feedback. If the test produces no retained users, stop and learn before adding volume. If it produces a small promising cohort, repeat the same motion before declaring the channel scalable.

What if you have too little data?

That is common for an early product. You can still make a decision without pretending that a small sample is a stable benchmark.

Use direct conversations and manual observation to understand the job. Instrument only the few events needed to follow the user from first value to repeat value. Amplitude’s setup guide notes that a retention analysis depends on instrumented events; an elaborate dashboard cannot repair missing event definitions.

For a low-frequency product, do not wait for daily usage. Observe the next natural customer action: the next order, monthly report, project, or renewal conversation. For a transactional product, some customers may leave because the job is complete. Mixpanel explicitly cautions readers to distinguish “happy churn” from churn, which is why interviews and context belong next to the chart.

Your first target is not “great retention.” It is a credible answer to: who returned, what did they do, and what made that return plausible?

FAQ

Is retention only for subscription products?

No. Subscription products often have an obvious renewal cycle, but any product can define a meaningful repeat event. A one-time service may track referrals, repeat projects, or a follow-on job instead of daily activity.

Should I stop all acquisition until retention is perfect?

No. Keep learning through small, controlled acquisition tests if they are affordable. The point is to avoid committing serious budget to a channel before you know whether it produces the kind of users who get lasting value.

How many users do I need before looking at retention?

There is no universal cutoff that makes a result true. Start measuring as soon as you can define the events, then label small cohorts as directional. Repeat the same test and look for a pattern before making a large investment.

Wrap up

Before your next growth push, write the starting event, value event, natural usage interval, cohort source, and stop condition on one page. Run the smallest acquisition test that can answer whether the right users return. If you want peers to pressure-test that experiment, bring it to the BuildPurdue cohort.

RetentionCustomer acquisitionProduct analytics