Beta Layouts

Introduction

Beta Layouts is an experimentation and roll-out hub, allowing discrimination of experience between groups of users, and collection of comparative analytics through the dashboarding tool, supporting fact-based decision making and ultimately - continuous improvement of business performance.

Gradually rolling out UI/UX changes in a media application has several benefits. One of the main benefits is that it allows you to test the changes on a small scale before fully implementing them for the entire user base. By using A/B testing method, you can compare different variations of the changes and determine which one performs better. This allows you to identify and fix any issues that may arise, such as bugs or user confusion, before they affect the entire user base. Additionally, a gradual roll-out allows you to gather feedback from a smaller group of users, which can be used to make adjustments and improve the changes before they are implemented for the entire user base.

A/B testing can help to improve business key performance indicators (KPIs) such as click-through rate, viewer engagement, and revenue by identifying and implementing changes that have a positive impact on these metrics. It also allows you to make more informed decisions about which changes to implement, as it is based on real-world data rather than assumptions.

Setup

1. Add Applicaster DI plugin to your version.

2. Add Quick Brick Layout Manager plugin to your version.

3. Create a new version build.

Define a new experiment

1. In the Studio Insights tab, go to Beta Layouts, and click on Add New.

2. Define the experiment properties:

   1. Name: define the experiment name (free text).
   2. Beta Layout: Choose the layout you want to experiment with from the layouts list in the dropdown.
   3. Tablet Layout: Optional field, relevant only when choosing a mobile layout. Leave it empty if you don't want to experiment with the Tablet layout.
   4. Distribution Percentage: Define the layout distribution percentage, a number between 1 to 99. This number will define the phase and number of users exposed to the Beta Layout. For example, when defining 15%, 15 out of 100 users will get the Beta Layout.
   5. Group Size Limit: Define the maximum number of users exposed to the Beta Layout. For example, when defining 10,000, after assigning 10,000 users to the Beta Layout, no additional users will be exposed to the Beta Layout.

3. Active the experiment when ready to rollout by clicking the status toggle.

Rollout an experiment on a specific app version

After defining the experiment and activating it in the Insights+ Beta Layouts section, we need to assign and enable it for the relevant versions.

1. Open the version Plugin Configuration section.
2. Go to the Quick Brick Layout Manager Plugin.
3. Open the A/B Testing Experiments section in the configuraiton panel.
4. Choose the relevant experiment in the Rollout Layout dropdown.
5. Enable the experiment when ready.
6. Save the configuration changes (those changes does not required a new build).

Geographic Segmentation

The Geographic Segmentation feature enables overriding the active layout with a different one for a specific list of countries. Override by country code will be a second priority after a/b experiments.

To deploy a different layout for a list of countries, follow to following steps:

1. Open the version Plugin Configuration section.
2. Go to the Quick Brick Layout Manager Plugin.
3. Open the Geographic Segmentation section in the configuraiton panel.
4. Countries - Choose the countries you would like to present with the different layout.
5. Geo Segment Layout - Choose the Layout you want to use for the selected countries.
6. Enable Geographic Segmentation - Enable or Disable Geographic Segmentation.
7. Save the configuration changes (those changes does not required a new build).