Mobile A/B Testing Revisited with These New Approaches

Posted by Juned Ahmed
3
Nov 26, 2016
172 Views
When launching an app, how can you ensure delivering your users what they want? Well, while there are several metrics to measure them but initially to start with the battle ahead of you what comes as most effective is the A/B testing.

What is mobile A/B testing?

Just as it sounds, it offers two different options referred as A and B. For every app features, design attributes and marketing aspects two different versions can be put to the test for measuring effectiveness. This test is widely called as A/B testing. Thanks to this method of choosing between two versions of app attributes, developers can have a clear idea of what is going to be more effective.

Why Is It Important To Run A/B Testing?

A/B testing is widely used by marketers to determine what are the aspects that can lead to more download numbers or user retention rate. Many apps achieved higher user acquisition, engagement, and retention after conducting A/B testing.
 
While the importance of A/B testing in mobile application development is well accepted, it is crucial to know the best practices and the most important elements that deserve priority for this.

Mobile A/B Testing best practices

There is a few time-tested principles and guidelines concerning mobile A/B testing that proved effective for numerous apps. Let us introduce here 5 best practices for mobile A/B testing.

Think from the user's perspective

First of all, you need to put yourself into the shoes of the users and accordingly consider every aspect of the app. Take note of every single detail and the differences between both versions.

Interact with the users

How can you know what the users want without communicating them? Without interacting with your users you cannot know what are the elements you need to test or what you should prioritize.

Plan your A/B testing

You need to start A/B testing with a specific plan. How you are going to address each and every customer expectations and how to prioritize them you need to plan beforehand.  Moreover, having a plan is important to evaluate the results as per your expectations in the end.

Decide what you will test

There are two aspects to it.  Either you can test app contents including features, design elements and consumable contents like texts, images, video, etc. On the other hand, you can test the reaction of your users and target audience in respect to your app store presence. If you are concerned about monetization model you should follow, you can put various price models to the test.

Give the time it needs

Lastly, while A/B testing you need to test at least 3 elements at a time to get a solid and clearly defined direction and you should allow the test running for at least a month or so.

Most important mobile A/B tests you should focus upon now 

App Icon

What users get introduced with before even knowing about your app? Well, it is app icon and that is why it makes the most important part of your app store presence.  As app marketplace is the prime area to address your target audience and gain acquisition, the app icon needs to be optimized for easily remembering. Do you know bad app icon is one of the top three reasons for being rejected by the Apples App Store? If you know not, take note that Apple considers good icon design is as important as the app itself.

Let us offer here a few of the effective tips for app icon design.
 
  • Think whether you can deliver a unique app shape?
  • Only use a maximum of two colors in the design and avoid color overload at any cost.
  • Do not use photography
  • Do not use text in app icon
  • Only use graphics that are highly relevant and useful to your app.
  • Make the design intuitive and intelligent to let users instantly understand the purpose of your app.


Lastly, you must remember that the app icon must stand out in appearance from the crowd. Offering the perfect balance between purposiveness and creativity is ideal.

App Price Point

For paid apps price always remains a crucial consideration. Just by making your app slightly overpriced you can drive away thousands of potential users. But how can you know which price will work for your app to get more acquisition and quality acquisition? Well, that is why A/B testing is there.

It also depends whether you should go for a higher number of downloads or higher revenues. While in some cases you would like to go for 50 downloads @ just $1.99 in the majority of cases the app makers would go for 100 downloads at just $.099. Does it depend on your app type, target audience and what you prioritize, revenue or user volume?

App Description

A mobile app needs a description to accompany for app store crawlers. Though there is no strict rule for App Store description, there are some time-tested practices nevertheless. But to assess whether to write shorter or longer one or to go for difficult or easy one, we need to test both options.

Build two separate landing pages while maintaining similarly as per app store pages in outward look and feel. In both pages place the CTA buttons on top beside the icon and app title. Now make the first description short, crisp and to the point while covering the app in depth in the second description. But in both try to catch attention as soon as the potential user lands on the page.

After you go through this test and get a winner, conduct another test, this time by including reviews in both of them. While offering positive reviews in one, place tag line Ito the other with app features listed at the end of the description. Such play with different and varying elements ultimately can open your eyes to many things.
 
Lastly, it is strongly advised to limit your testing endeavors to maximum three at a time as this would help you tweak with the variable elements and gain invaluable insights.


Comments
avatar
Please sign in to add comment.