Compatibility testing is a Nonfunctional Testing which aims at checking or validating of whether the application behaves as expected across different mobile devices and browsers in which the end users (customers) will access the application.
Why is Compatibility testing important?
To test whether the Application supports all platforms
- The application might not support all the resolutions since the design and the technology will be dependent on the customer’s requirement.
- The application might not support all the devices because multiple devices are available on Android, iOS and Windows OS with multiple screen resolutions.
- The application will not work in all the hardware combinations since it depends on the application functionality.
Continue Reading
It is important to test the applications compatibility in different combinations. This testing is to be done to ensure a competitive edge in terms of quality, compatibility, cost, and delivery for the final product before it is delivered to the customers.
Compatibility testing can be performed by considering the following aspects
Platform:Mobile platforms such as Android, iOS, Windows, and Linux etc.
Platform versions:
- Android – Nougat, Marshmallow, Lollipop, KitKat etc.
- iOS – 10, 9, 8, 7, 6, 5 etc.
- Windows – 10, 8.1, 8 etc.
Devices:
- Android – Micromax, Google Nexus, and Samsung etc.
- iOS – iPhone 6, 6 Plus, 5 and 5S etc.
- Windows – Microsoft Lumia 435, Acer, Nokia Lumia 620 and HTC etc.
Resolutions:
- Android – 720×1280, 480×800 and 1280×800 etc.
- iOS – 2560×1440, 1024×600 and 1280×800 etc.
- Windows – 1024×600, 1280×800 and 960×540 etc.
Browsers:
- Android – Chrome, default browser and Mozilla Firefox etc.
- iOS – Safari and Chrome
- Windows – IE, Chrome and Mozilla Firefox etc.
Hardware:
- Memory
- Processor
- Network mode – 2G, 3G, 4G and Wi-Fi
Challenges in compatibility testing
One of the top most challenges faced in the organization is how to test their mobile app on all possible combination of end user devices and platforms. The mobile market is continuously growing with OS upgrade and new device release with different hardware combinations. Some of the most common Compatibility Testing Defects are,
- Difference in User Interface in terms of Alignment
- Specific control is not working
- Changes with respect to font size and color
- Existence of broken tables or Frames
- Application crashing due to insufficient memory
Compatibility testing process
- Define the Application scope by considering the following
- Platform
- Resolutions
- Platform versions
- Hardware combinations
- Device can be selected by considering the scope and Industry standards
- Selecting the Emulator/Simulator to test the applications in terms of Usability in all the possible combinations
- Sometimes implementing the application results in Emulator / Simulator devices may vary when comparing it with the results implement in real devices.
- Real device testing is necessary to ensure the application quality in terms of performance, network change and real hardware components
- The Web and Hybrid applications can be accessed in the mobile browsers. Selecting the browsers for an Android device is based on the customer requirement and also it should meet the industry standards. Since the default browser of the android is changed for the different devices.
- In iOS and Windows, the mobile default browsers is Safari and IE respectively. It helps to ensure the application quality in the less time.
- Applications can be tested in terms of version in any of the following types
- Backward – Verify that the application designed using the latest version of an environment also works seamlessly in an older version.
- Forward – Verify that the software is compatible with the newer or upcoming versions.
