0

Context:

  • We have our ad revenues tracked in Firebase and what we see as "daily ads revenues" in Firebase Analytics is matching what we see in our Ads manager (AppLovin) plateform.
  • We have a firebase remote config A/B test running and one of our goals is "estimated Ad Revenues".
  • We have been running the test for > 12 days so far and the "average revenues per user" numbers are now quite stable in the A/B test.

Problem:

In Observed Data of the A/B test, the total revenue and the average revenue per user are way higher than the real numbers. For example the sum of the total revenue of the 2 variants is more than 30% higher than the total revenue we see in our ad plateform, or in firebase analytics.

Question:

I'm probably misunderstanding what "Observed Data" means in this context, i'm expecting the Total Ad Revenue and the Avg Revenue per user to be "what was seen" and the modeled data to be the projected estimation but since it's overall talking about "Estimated Ad Revenue", I'm confused and I don't know how to read the ad revenues numbers in the A/B test results.

The documentation is fairly light on this topic. Does anyone know ?

  • Did you find an answer to this? I’m in the exact same situation and do not understand how to read the modeled data. – Christoph May 24 '23 at 05:18

0 Answers0