How to Pause Test Variations in Visiopt

Overview

This Standard Operating Procedure (SOP) outlines the process for pausing test variations in Visiopt. This powerful feature allows users to pause underperforming variations while a test is still running, without affecting the Visiopt smart algorithms. Use this feature carefully and ensure you have reached the appropriate audience size before making any changes.

Step-by-Step Instructions
 

Step 1: Understand the Feature
 

1. Caution on Usage

·   This is an advanced feature and should be used carefully.

·   Ensure you understand the implications of pausing test variations before proceeding.

Step 2: Check Audience Size
 

1. Audience Size Requirement

·   The option to pause variations will only become available once you have reached your proper audience size.

Step 3: Pause or Unpause Variations
 

1. Locate Pause Variation Column

·   For each variation, there will be a "Pause Variation" column with a pause button.

2. Pause a Variation

·   Simply push the pause button to pause a variation.

·   A warning will appear, and the paused variation will turn pink to indicate its status.

3. Unpause a Variation

·   To unpause, click the button again. The variation will return to its active state.

Step 4: When to Use This Feature
 

1. Managing Outliers

·   If certain variations are underperforming significantly, consider pausing them.

·   Ensure you have enough data before making this decision.

2. Verifying Results After Test Completion

·   After a test is completed, pause all variations except for your control or the top-performing variations.

·   This allows you to verify results without setting up a new test.

3. Dealing with Multiple Winning Variations

·   If more than one variation outperforms the control significantly, pause the control and all losing variations.

·   Let the winning variations run against each other.

Step 5: Data Management
 

1. Paused Data Handling

·   Data will stop recording for the paused variation and it will no longer rotate to visitors.

·   Review data from the paused date onwards to accurately view test results.

Step 6: Record Changes
 

1. Use Test Notes

·   Record when you pause your tests using the Test Notes feature.

·   This helps keep track of all test changes and ensures proper documentation.

Conclusion

By following these steps, users can effectively manage and pause test variations in Visiopt. This ensures that only the most relevant and high-performing variations continue to run, optimizing the testing process and results.