A/B test in iOS: 4 weeks for getting significance?

Wanna launch an A/B test in iOS but don’t want to wait 4 weeks for getting some significance?

Here’s a faster way: Use paid UA to speed up your testing and decision-making process.

Follow these steps:

1️⃣ Create two CPPs: One should replicate your default page, the other should be the variant you want to test
2️⃣ Create one CPI campaign in Meta, targeting the country you want to test (ideally the one that brings most of the revenue)
3️⃣ Create 2 ad groups within the same campaign and put on each one your best creative (one of those that you know that will easily produce installs)

IMPORTANT! the creatives MUST BE the same in both ad groups. Otherwise the A/B testing wouldn’t make sense as more variables would affect the final conversion rate

4️⃣ Spend $100/day in each ad group and wait 3-4 days.
5️⃣ Enjoy having fast data to make much faster decisions on the design of your default page

The example I put in the screenshot is just one I launched two days ago but in that case I’m comparing it to an older CPP which is a copy of the default app page. It looks like the new design is better but I will wait couple of days more.

Ideally you start the test with the setup I recommended above so you have same starting points and same campaign.