This episode reveals the critical findings from CTC’s incrementality tests on Meta’s new attribution tool, highlighting its limitations, especially for new customer acquisition. Learn how to conduct high-fidelity geo holdout tests using Shopify revenue data to accurately measure marketing ROI and adopt a "cautiously curious" mindset for new attribution tools. This is crucial for ecommerce operators wanting to move beyond superficial metrics and truly understand their paid media effectiveness.
Key takeaways
Meta's Incremental Attribution Tool may overstate its impact, particularly on new customer acquisition; don't rely solely on platform-native data.
Implement geo holdout tests with real Shopify revenue data to get a high-fidelity understanding of true incremental impact. This is more robust than relying on internal platform metrics.
Adopt a "cautiously curious" mindset when evaluating new attribution tools. Always validate claims with independent testing methodologies.
Understand that causation and incrementality are distinct from correlation; focus your measurement efforts on determining what additional sales would not have occurred without specific advertising spend.
Design incrementality tests that mirror your actual business operations and customer journeys to ensure the results are relevant and actionable for your ecommerce strategy.
After months of speculation, testing, and internal debate, CTC put Meta’s new Incremental Attribution Tool to the test—three times.In this episode, Richard Gaffin sits down with VP of Paid Media Tony Chopp to break down what really happened across those tests, including a final geo holdout study using actual Shopify revenue. The result? You’ll learn:- What CTC’s 3 incrementality tests revealed about Meta’s new attribution tool- Why Meta’s results may be overstating impact—especially on new customer acquisition- How to run a high-fidelity geo holdout test with real revenue data- Why “cautiously curious” is the right mindset for adopting new attribution toolsShow Notes:Want to see how real customers experience your brand across channels?Request your FREE Mystery Shopper report from our sponsor, Stord: https://stord.link/mysteryExplore the Prophit System: https://prophitsystem.comHave a question for the podcast?Email us: podcast@commonthreadco.com
What does this episode say about paid acquisition?
Meta's Incremental Attribution Tool may overstate its impact, particularly on new customer acquisition; don't rely solely on platform-native data.
What does this episode say about analytics & attribution?
Implement geo holdout tests with real Shopify revenue data to get a high-fidelity understanding of true incremental impact. This is more robust than relying on internal platform metrics.
What does this episode say about dtc strategy?
Adopt a "cautiously curious" mindset when evaluating new attribution tools. Always validate claims with independent testing methodologies.
What does this episode say about paid acquisition?
Understand that causation and incrementality are distinct from correlation; focus your measurement efforts on determining what additional sales would not have occurred without specific advertising spend.
What does this episode say about paid acquisition?
Design incrementality tests that mirror your actual business operations and customer journeys to ensure the results are relevant and actionable for your ecommerce strategy.
