Convertize Autopilot Mode Automatically Allocates Traffic to the Better-Performing Variant in an A/B Test
Convertize, a recognized digital consulting agency that specializes in Conversion Rate Optimisation, has announced its latest feature – Autopilot Mode. Based on a new algorithm devised for their A/B Testing and Notifications platform, Autopilot Mode automatically allocates traffic to the better-performing variant in an A/B test.
A/B testing gives retailers of any size and within any sector the ability to statistically analyze more data points over a shorter period of time. It also allows users to accurately apply more complex statistical algorithms that take past outcomes into account.
Autopilot Mode combines the Frequentist and Bayesian approaches to AB testing.
Philippe Aimé, CEO of Convertize, explained, “In our experience, the Frequentist approach is faster, but Bayesian can be more reliable. Not wanting to forgo either benefit, we devised a hybrid approach. The result is an algorithm that continually recalculates the best performing variant and automatically pushes more traffic to it.”
The feature has been designed to maximize the value of the better performing variation of an experiment. This will help to minimize the opportunity cost of AB testing by recalibrating the traffic distribution continuously.
Once the test is completed, the majority of visitors will be taken to the higher converting version of a retailers website. This results in a smoother optimization process, ensuring that conversions are maximized whilst running tests. Autopilot mode also considers how results are changing over the course of the experience, whilst also taking into account the differences in consumer behavior on different days of the week.
Aimé continued, “The use of a hybrid approach of Frequentist and Bayesian in A/B testing means that users of the Convertize platform are now able to leave the algorithm to decide on the traffic split for their A/B tests.Typically, there is strictly no-peeking at results before A/B testing is complete as this could prevent the experiment from being accurate. This could mean weeks of potentially trying to direct a large proportion of visitors to a less-optimal variant, which can cost companies vast amounts of money.”
Currently, Convertize helps simplify the building and testing optimization hypotheses using effective A/B testing tools.Convertize’s approach aims to eliminate this confusion. Thanks to simple and effective methods, Convertize helps its clients to improve their websites and to quickly and efficiently increase online revenue.