Testing Automation Accelerates Global Reward Brand’s Time to Market
When this global retail rewards brand wanted to speed up its deployment of new reward propositions, its attention turned to test automation. Using this methodology, they hoped to onboard and deploy reward propositions in a fraction of the time.
The business needed more commercial agility.
Manual testing processes were hindering onboarding and deployment of new reward propositions.
Commercial acceleration owing to greater testing efficiency.
Cutting down overall testing time 75% meant significant improvement in the time-to-market of new reward propositions.
Client’s delivery platform was able to handle the extreme load.
An automated regression testing solution to maintain a robust platform even with surge capacity over five million users.
The Client is the retail rewards arm of a globally recognized and respected brand founded in 1970. With a group turnover of circa $22 billion, their core consumer sectors include: Travel & Leisure, Health & Wellness, Music & Entertainment, Telecoms & Media, Financial Services and Space.
“The Client wanted their own staff to be able to easily set up, configure and run regression tests for themselves.”
Wanted: Automation of manual testing processes. Purpose: Commercial agility
The Client found their manual testing processes were hindering commercial agility. To fast-track new reward propositions, through onboarding to release to customers, they wanted better test capabilities. They also wanted to reduce costs, increase test coverage and future proof. This meant for their own staff to be able to easily setup, configure and run regression tests for themselves.
To achieve all this, they wanted to automate elements of their testing. The Client needed to achieve an optimal level of automation on both their mobile app and web application platforms. They did not have the expertise in-house to suggest how they could implement toolsets for automation testing or how automated monitoring solutions could identify testing bottlenecks.
Three steps to test excellence at scale
Qualitest worked with the Client to build an automated testing solution that would accommodate mobile testing on both Android and on iOS platforms. An iterative process was planned with three clear phases:
1. Identifying the right framework
Qualitest engineers, automation test specialists and system architects undertook enterprise-level fact-finding into the Client’s existing systems. In scope were business process, volumetric and system-usage information.
After several proof of concepts, Qualitest identified the right solution to run automated tests: Selenium + C# with Appium as the automation testing platform. This would be intelligent enough by itself to pick test scripts from those available and to build the test suite. It would identify and execute the pre-requisites test script(s) before triggering the actual regression run.
2. Regression run simplification
Simplification of regression testing involved removing manual operations and dependencies on the automation expert. A simple command and single click triggers the complete regression run. On completion of the run, logs are set apart in their respective folders with evidence. All the pass and failed test scripts are captured along with the execution flow. The tool is user friendly, compatible, easy to maintain and requires no manual intervention during execution.
“The tool is user friendly, compatible, easy to maintain and importantly no manual intervention during execution.”
3. Parallel execution
All necessary steps were taken for the regression run to execute on both Android and iOS. This meant the solution was platform independent with both Windows and MacOS supported. Parallel execution meant test coverage and testing quality were significantly increased, and testing time was reduced significantly, giving a significant ROI boost.
“Qualitest worked with the Client to build an automated testing solution that would accommodate mobile testing on both Android and on iOS platforms”
- Commercial acceleration – Cutting down overall testing time 75% meant significant improvement in the time-to-market of new reward propositions.
- Cost efficiency – With tests now able to run in quick succession, cost-per-test was significantly lower.
- Parallel execution – Helped the Client move into continuous and seamless delivery with timely reporting and quick feedback made easy and available with different file extensions.
- Testing futureproofed – A simple command will trigger regression test suite, meaning anybody can run it globally with test logs stored safely but accessibly. Testing at higher speeds, the team could begin to penetrate the larger areas where automation had not been achieved and pinpoint bugs there faster.