Skip to content

Blog

Incrementality Overview

Published February 3, 2025 by Sneha Popley

Incrementality Overview

Retail media has quickly become the fastest growing channel in digital media.  However, traditional attribution and measurement methods have left advertisers skeptical of the true value of their investment in driving sales growth. After all, many advertiser retail media network (RMN) budgets come from existing budgets, and 85% of advertisers simply feel pressured to buy retail media. Today, some advertisers view retail media as “the cost of doing business” rather than a key driver for major advertising initiatives like awareness or branding.

One key way retailers can improve this dynamic is through improving standardization and measurement– walled gardens that only promote bespoke measurement do not allow advertisers to measure the real impact of their ads across different RMNs, and they prevent advertisers from seeing if return on ad spend (ROAS) results are truly incremental. By offering incrementality measurement, retailers can captivate and retain advertisers, even extending budgets into the upper-funnel.

What is incrementality?

Incrementality measures the impact generated by advertising activity compared to what would have happened organically.

Imagine a campaign where a soda brand, purchases a top-sponsored placement for the search term “soda” on a retailer’s website. While the RMN may be able to directly tie on-site purchases to the ad’s activity, the brand may not see any significant sales lift overall. In this case, the ad is being actioned by users that would have purchased anyways, and the ad did not cause the brand’s sales to increase.

In the past, retail or commerce media networks simply offered measurement such as ROAS. However, advertisers began to push back as this metric didn’t measure if their ads were influencing customer buying behavior. Now, with incrementality measurement, brands can see the impact of their ads vs organic activity run. Retailers can directly report to advertisers that their ads influenced customer behavior and made a substantial difference in the advertiser’s sales.

Overall, incrementality measurement enables brands to quantify the real value ads bring to their campaigns, helping retailers retain advertiser trust and even expand budgets into upper-funnel branding efforts.

How incrementality measurement works

The industry standard in retail media is A/B testing incrementality.

In A/B Testing, publishers split users into two groups. A small portion of users is excluded from receiving any ads. These “holdout groups” serve as a baseline to compare the performance of targeted users.

Incrementality metrics like Incremental Conversions, Incremental Revenue, Incremental CVR, and Incremental ROAS are calculated by comparing the relative performance of the test group vs the control group.

The importance of incrementality

As most funding for RMNs comes from shopper marketing budgets, incrementality helps retailers prove effective shopper marketing results while also examining how their platform could drive results from brand and upper-funnel budgets as well. The ANA reported that over 60% of RMN spend has been taken from existing budgets– if RMNs want incremental spend, they need to prove incremental results.

Commerce media networks benefit from incrementality because they can:

  1. Prove incremental ROAS to advertisers that shows how running campaigns impact actual revenue and order value compared to organic results
  2. Push for greater budgets from advertisers if they can show clear ROI
  3. Increase competition for ads between brands to increase placement value  
  4. Increase overall budgets and spend on their platform
  5. Better understand their ad placement performance on-site to improve user experience

For example, Koddi recently ran an incrementality pilot with a publisher that drove over $300,000 in incremental budget across 5 advertisers due to encouraging incremental data performance.

Advertisers benefit from incrementality because they can:

  1. Compare brand performance of organic placements vs. ad placements on their platform to quantify the value of ads to their business 
  2. Provide actionable insights to help allocate budgets effectively
  3. Help identify the most valuable audiences
  4. Unlock deeper insights into ROI and growth sources within marketing strategies so they can make data-driven decisions
  5. See an increase in brand sales and revenue from users exposed to ads vs those who weren’t 

Advertisers have seen up to a 6x incremental ROAS with up to 13% incremental sales in previous tests on the Koddi platforms.  

Incrementality vs attribution

Commerce media networks have long used attribution as a key way to measure the impact of ads on overall sales. Attribution clearly ties sales to ads that a user viewed, clicked on, or interacted with previously. It outlines the user journey from the ad to the purchase. 

Incrementality takes this a step further. Attribution can tell an advertiser if a user clicked on a sponsored product and added that product to cart. But it can’t tell the advertiser if that product wasn’t sponsored, would the user have still added it to cart anyway? Take our previous example. If the user searched “soda,” would they have clicked the specific brand regardless of if there was an ad there or not? Incrementality can give the advertiser that insight, whereas attribution can only matter-of-factly declare that the ad led to a sale.

Challenges commerce media networks face when launching incrementality

Incrementality sounds simple, but in reality can be complex to launch. Commerce media networks will need to factor the following capabilities when building for measuring incrementality.

  1. Audience segmentation: Commerce media network tech must have the ability to segment users into control and test variants, and consistently apply the treatment in real-time. Additionally, they’ll need to perform audience segmentation analysis to ensure audience randomization.
  2. Data collection: This ensures that all relevant signals are captured for both of the A/B test groups, even when ads aren’t shown. 
  3. Post-test analysis: Commerce media networks will need to run best practice statistical analysis on the result set to determine the results of the test at statistical significance levels. 
  4. Incrementality reporting and storytelling: Incrementality measurement is a nuanced metric that can be confusing to advertisers who are new to the concept. Test results must be presented in a way that advertisers understand in order to drive results.

Working with Koddi for incremental results

Launching incrementality testing isn’t easy– that’s why major retail and commerce media networks choose Koddi as their partner. Leverage our incrementality testing to prove ROAS to your advertisers quickly, with no additional work  on your teams. Contact us today to see how you can show measurable results. 

Ready to get started?