Optimizing your pages performance is key to increase sales and conversions. Our A/B testing tool provides you with the tools to do this.
A/B testing is currently available on the Optimize plan. If you would like to upgrade, you can do so in the Settings of your Shogun dashboard, or get into contact with support if you are on a legacy Shogun plan.
How to Create an A/B Test
Getting an A/B test started is easy. Simply click on the 'Start Test' option in the menu in the top-right of the editor.
Starting a test will create a variant of the page in a tab named Variant A at the top of the editor. You will also see the original version of the page in a tab named Original. This can be used to compare the two versions of the page that you have created.
Create different content in the "Original" and "Variant A" editor tabs to test which version is best received.
What metrics can I compare?
Shogun currently offers you three metrics to compare your page variants:
- Clickthrough
- Sales
- Add to Cart
Tracking clickthrough on a Shogun page
When starting a test, you can choose to select the 'Clickthrough' metric to measure the variant of the page. This will measure the traffic of users through this page to another page of your choice. To get started, click 'Start Test' and select 'Clickthrough'.
You can link to a page within your Shogun account, or a URL, for example, to your cart!
Tracking sales on a Shogun page
The second option within the A/B testing tool is to track sales on your Shogun pages. This will track the order from addition of the product to the cart, right to the sale of the product.
Tracking Add to Cart clicks on a Shogun page
The final option to track your Shogun page performance is based on the amount of visitors clicking the 'add to cart' button on your pages. This is a great metric to compare to sales to determine if your visitors adding a product to their cart is translating into a sale or not.
How do I set who sees this test?
After you click 'publish' you will be given the option to set the 'Variant Percentage', this is the percentage of your visitors that will receive the variant of your page.
Automatically setting the page live
If you would like the test to handle itself, you may set it to auto publish once enough data has been collected and we have confidence in a winner. Set auto pilot on if you would like this to happen.
Setting a timeframe for your test
If you do not want us to automatically publish the page when we have a result, you can set your own timeframe on your test. First, set auto pilot to off and you will be presented with more options.
You can then set this to auto publish the best performing page once this test has completed by checking the 'publish winner on completion' option.
How do I know if a test is running?
You will see this in your dashboard when you are running a test, you will notice that the status of the page is 'running test'.
Opening this page will also let you know that a test is running for this page.
How can I view the results of my test?
No test is complete without results! Simply open up the page and you will be given the option to check out the current results of the test, even if it is still going!
This can also be accessed through the page analytics!
What happens when my A/B test ends?
Your test will run for the duration that you set it to run for, or, if you have chosen the more automatic route, this will run until we have a clear winner based on the confidence level of the variants.
When a test has ended, you will see four key pieces of information about the test.
- The user sessions: this is the amount of users that took part in the test on the pages
- How long the test ran for in total
- Our confidence in the winning variant
- The winning variant, whether it was the original or the variant of the page
Viewing old versions of variants
You can easily view older variants of a page, or variants that have been tested on the page by using the Versions tool. For versions with variants, you will see the 'Show Variants' option, clicking this will show you the variants of your page and give you the option to revert to these, if you choose.
Note: The A/B testing feature is currently available for select platforms and plans. Please contact our support team for details on how to add this tool to your account.