The 2026 Measurement Crisis: Why Your Media Efficiency is Probably a Lie With Sally Kazin and Ross Walker - Episode 438
Ecommerce Braintrust · with Sally Kazin and Ross Walker · July 28, 2026 · 26 min
Summary
The 2026 Measurement Crisis is here, and your media efficiency metrics are likely an illusion. This episode dissects how privacy changes, platform biases, and duplicated attribution inflate ROAS and hide the true impact of your ad spend. Learn why relying on dashboard numbers is a dangerous game and what actions ecommerce brands must take to gain an accurate understanding of their marketing performance before it's too late.
Key takeaways
Platform-reported ROAS is inflated due to duplicated attribution and platform biases; always assume platforms over-report their impact on sales.
Privacy changes are forcing a shift from reliable observation-based tracking to estimation, making it critical to develop robust internal measurement models.
Siloed data across various platforms (DTC, marketplaces, social) prevents a holistic view of performance, necessitating integrated analytics for accurate measurement.
Focus on incrementality testing and developing "ground truth" metrics rather than blindly trusting platform-specific ROAS to understand true media effectiveness.
Actively identify and account for the inherent biases of each advertising platform when evaluating campaign performance to avoid financial misallocation.
Welcome to The Ecommerce Braintrust podcast, brought to you by Julie Spear, Head of Retail Marketplace Services, and Jordan Ripley, Director of Retail Account Management. Today, we are getting into something every brand needs to hear - because what you think you know about your media performance might be complete fiction. We're talking about the 2026 measurement crisis. The moment when the gap between what your dashboards say and what your account shows has become impossible to ignore. And to help us make sense of it all, we have two incredible guests from the Acadia team with us: Sally Kazin, Head of Analytics, and Ross Walker, Director of Retail Media. Let's dive in! Quote: The gap between the dashboard numbers and the ground truth has become impossible to ignore. Sally Kazin KEY TAKEAWAYS In this episode, Julie, Jordan, Sally, and Ross discuss: The growing "measurement crisis" in ecommerce, where platform-reported revenue often exceeds actual sales due to duplicated attribution claims across channels Transition from reliable observation-based tracking to a world of estimation and modeling, driven by privacy changes and a fragmented platform landscape The challenges posed by siloed data, platform biases, and engine inflation in retail media and traditional paid channels Widespread overreliance on ROAS as a North Star metri
What does this episode say about analytics & attribution?
Platform-reported ROAS is inflated due to duplicated attribution and platform biases; always assume platforms over-report their impact on sales.
What does this episode say about paid acquisition?
Privacy changes are forcing a shift from reliable observation-based tracking to estimation, making it critical to develop robust internal measurement models.
What does this episode say about dtc strategy?
Siloed data across various platforms (DTC, marketplaces, social) prevents a holistic view of performance, necessitating integrated analytics for accurate measurement.
What does this episode say about analytics & attribution?
Focus on incrementality testing and developing "ground truth" metrics rather than blindly trusting platform-specific ROAS to understand true media effectiveness.
What does this episode say about analytics & attribution?
Actively identify and account for the inherent biases of each advertising platform when evaluating campaign performance to avoid financial misallocation.
