Discover why measuring incremental lift—not just attribution—should be your marketing North Star. Learn proven frameworks, case studies, and actionable steps to measure true impact.
ICYMI
Incrementality isolates the causal lift your marketing produces—what wouldn’t have happened without your intervention—making it the only metric that truly proves marketing’s real impact.
1. The Problem: Why Traditional Marketing Metrics Fall Short
In today’s digital marketing world, teams rely heavily on attribution models—last-click, multi-touch, or data-driven—to measure success. The flaw? They measure correlation, not causation.
A shopper might click a branded search ad and convert, but if that shopper was already intent-driven, the ad didn’t create value—it simply claimed credit.
As Skai notes: “Many marketers end up allocating budget to activities that would have converted anyway.” Without identifying what the marketing caused, you can’t answer the critical question: “If we hadn’t done this, what would have happened?”
Recent studies show attribution-based models can overstate impact by as much as 6x compared to hold-out experiments. The result? Inflated ROI and misallocated budgets.
2. The Core Concept: What Is Incrementality?
Incrementality measures the additional value—sales, leads, or conversions—caused by marketing activity that would not have occurred otherwise.
Formula:
Incremental Lift = Results (with campaign) – Results (without campaign)
If your exposed group has 1,250 purchases and your control group 1,000, your campaign added 250 incremental purchases (25% lift).
Attribution asks “Who gets credit?”
Incrementality asks “What changed because of us?”
This distinction helps marketers:
- Expose budget waste on non-incremental channels.
- Identify true growth drivers.
- Align metrics with business outcomes like net new revenue.
3. Why Incrementality Is the Marketing North Star
Incrementality is rising fast because of:
- Budget pressure: CMOs need proof of change, not just activity.
- Privacy limits: With cookie loss and restricted tracking, causal testing is more resilient.
- Channel fragmentation: Too many platforms, each claiming credit.
- Saturated audiences: More ads don’t always mean more conversions.
A healthcare marketing firm found incremental CPA on paid search was 5x higher than blended CPA, revealing wasted spend on already-intent-driven users. Incrementality shifts focus from credit-taking to true value creation.
4. How to Measure Incrementality – Frameworks and Methods
| Method | Description | Best For | Benefit |
|---|---|---|---|
| User-level holdout | Randomly assign users to test/control | Paid social, display | True causal impact |
| Geo holdout | Run ads in some regions, pause in others | Retail, CTV | Large-scale testing |
| Synthetic control | Model what would have happened without campaign | National or brand campaigns | Useful when no holdout possible |
| MMM calibrated with lift tests | Combine econometrics with experiments | Long-term strategy | Integrates with budget planning |
Best Practices:
- Keep control and test groups equivalent.
- Run tests for 2–4 weeks minimum.
- Avoid contamination (e.g., overlapping reach).
- Focus on incremental metrics like iROAS or incremental CPA.
- Validate statistical significance before reporting.
Common Pitfalls:
- Treating A/B creative tests as incrementality tests.
- Running short-duration or low-volume tests.
- Ignoring long-term brand effects.
- Misreading “no lift” as failure—it might indicate saturation or intent harvesting.
5. Case Studies: Incrementality in Action
Case Study A: Shinola (Luxury Goods Retailer)
Problem: Suspected social ads were overstating impact.
Method: Geo-matched ZIP code holdout.
Result: +14.3% conversion lift—actual performance was underreported by 413%.
Outcome: Reallocation toward higher-impact social segments.
Case Study B: ServicePro (Local Services Firm)
Problem: Unsure if Google Ads were driving new leads or capturing organic ones.
Method: Geographic holdout (ads paused in control markets).
Result: 40% of leads were truly incremental; $25k spend yielded $100k incremental revenue (400% ROI).
Outcome: Shifted budget to SEO and high-impact paid search.
Case Study C: Retail Media Network (Large CPG Brand)
Problem: Retailer ad network showing inflated sales lift.
Method: Geo holdout across store territories.
Result: Minimal incremental lift; most sales were organic.
Outcome: Budget shifted toward precision segments targeting new customers.
Insights:
Incrementality often reveals that high “performance” channels may have limited real impact—helping teams trim waste and focus on genuine growth drivers.
6. How to Implement Incrementality Measurement
Fast-Start Checklist
- Define business objectives (incremental revenue, new customers).
- Choose a channel or campaign with uncertain impact.
- Set up test and control groups.
- Decide test length and target volume.
- Run campaign—test exposed, control withheld.
- Measure incremental lift, revenue, and iROAS.
- Validate results statistically.
- Scale what works, pause what doesn’t.
- Feed results into MMM and budgeting.
- Repeat quarterly for continuous optimization.
Tools
- Google Ads geo-holdout features
- Meta Conversion Lift
- Causal inference tools (e.g., uplift modeling)
- Econometric modeling (MMM with incremental calibration)
Metrics to Track
- % Incremental lift
- Incremental customers
- Incremental revenue/margin
- iROAS or incremental CPA
- Budget reallocation efficiency
Example Timeline:
- Week 0: Design test/control groups
- Weeks 1–4: Run experiment
- Week 5: Analyze results
- Week 6: Present findings, optimize budget
- Ongoing: Repeat across channels
7. Limitations to Consider
- Short-term focus: Lift tests may miss brand or LTV impact.
- Cost: Pausing campaigns for control groups can be expensive.
- Contamination: External events or overlapping audiences can skew results.
- Data privacy: User-level testing harder under new privacy laws.
- Channel overlap: Effects between channels may distort pure lift.
Mitigate by:
Combining short-term experiments with long-term MMM, documenting assumptions, and aligning results with business strategy.
8. Conclusion: From Credit-Taking to Value Creation
Marketing success is no longer about who gets the credit—it’s about what changed. Incrementality measures that change directly.
Adopting an incrementality mindset allows marketers to:
- Eliminate wasteful spend.
- Prove real business impact.
- Future-proof measurement in a privacy-first world.
Attribution tells you who touched the conversion.
Incrementality tells you what wouldn’t have happened without your marketing.
That’s the true measure of marketing impact.
Fast-Start Summary
- Define incremental goals
- Pick test channel
- Build test/control
- Measure causal lift
- Validate and act
- Feed insights into future planning
0 Comments