Skip to main content

Botsi A/B Tests

A/B testing in Botsi is a powerful way to optimize your Paywall performance by experimenting with different variations to find the one that drives the best results. Whether you are focused on conversion rates, revenue, or retention, Botsi provides data-driven insights for smarter decisions.

Test real user behavior and scale what works best, optimizing for first-time purchases, retention, or subscription upgrades.

Understand A/B Testing​

In an A/B test (also called a split test), two or more variants of a Paywall are shown to different segments of your Audience. Each version can test different elements, such as:

  • Layout and design
  • Pricing options
  • Offer structure (e.g., trial vs. no trial)
  • Feature highlights or CTA buttons

This lets you experiment with different strategies to see what resonates best with your users.

How A/B Testing Works in Botsi​

Botsi makes it easy to set up and manage A/B tests directly from the AB Testing section, available in the left sidebar of your app. Here’s a high-level overview of how it works:

1
Start with a Placement

Each A/B test is connected to a Placement, which defines where and when a paywall appears in your app. If you haven’t set up a placement yet, refer to the Placements guide to configure one before launching your test.

2
Define Paywall Variations

After selecting your placement, you will choose which Paywalls you want to test. These can differ in layout, pricing, messaging, or design. Botsi automatically splits user traffic evenly between variations, but you can fine-tune distribution if needed (e.g., 40-60).

3
Target Your Audience

Use Botsi’s segmentation tools to run tests on specific groups like new users, users in a certain country, or iOS vs Android audiences. This helps you learn what works best for each segment.

4
Track Performance

Once the test is live, Botsi tracks performance across key monetization metrics such as:

  • Revenue: Total revenue generated per variation.
  • Conversion Rate (CR): Percentage of users who purchased or started a trial.
  • Trial Starts and Cancellations: How many users began a trial and how many canceled.
  • Unique Paid Subscribers: Number of distinct users who completed a purchase.
  • ARPPU (Average Revenue Per Paying User): Revenue per user who made a purchase.
5
Select a Winner

Once you have gathered enough data, you can confidently apply the winning Paywall variation to all users. Or, if you are still experimenting, keep iterating to test new ideas and improve results over time.

What's Next?​

To learn more about A/B Tests, check the following pages: