Client overview 

Our client is a leading multinational technology company that is primarily focused on online advertising, search engine technology, artificial intelligence, quantum computing, e-commerce and consumer electronics.  

They have significant technological advantages in the field of artificial intelligence, search and online ads and is one of the world’s most valuable brands. They strive to organise the world’s information and make it universally accessible and useful for all. 

What’s in an app! No one would like a crash feature for their favorite app 

Our client required tens of thousands of mobile apps to be tested continuously, and usage data was collected and leveraged to optimize the performance and reliability of the app. It was taking them weeks to complete the weekly backlog, and new apps were added weekly increasing the backlog with no end in sight. There was also the need to reduce the existing backlog and get testing on track to complete the weekly backlog that has accumulated. 
 
Their plan to increase test analysts to the onsite team would significantly increase the costs for the project. There were also some constraints with the current process including: 

  • Automation was not an option since there were hundreds of apps to be tested and which were varied in features. 
  • There was difficulty in assembling a large team of testers onsite due to availability of skilled testers and costs. 

These constraints posed a huge challenge for the program that resulted in: 

  • Cost escalations and increasing the overall project budgets due to people costs. 
  • Increased pressure on the talent acquisition teams to find the right talent within budgets. 
  • The backlog of apps to be tested increased with slow progress to reverse the trend. 

When apps crash often: data centric testing and remediation is a no brainer for greater stability 

The project ramp up was a phased approach: 

The pilot phase  

Analysis and planning was based on initial requirements, design workflows and project delivery mechanism.  The delivery team researched optimal technology and tooling based on project objectives. The next logical step was a dry run of the solution on a sample set of apps, to optimize and make changes to the technology/tools. Once the proof of concept was established, the solution was showcased to the client for approval. 

One-time effort  

This phase was an extension of the pilot phase, with the goal being to scale the proof of concept to ramp up the project delivery capabilities in terms of processes, tools and people, address the thousands of pending apps and reduce it to a manageable level for the core team. There was a spike in resources to achieve the goal in a fixed time period, after which there was a ramp down of the team after achieving a steady state and then activities like process optimization, delivery performance metrics & measurement were implemented. 

Ongoing effort 

Based on the learning from the pilot and one-time phases, this phase established a long-term delivery strategy to address the current and future increase in testing backlog. The team was ramped down to a “core” group for the long term that optimized the delivery model which resulted in overall cost savings. 

A hybrid model optimized delivery set the tone for long term project success 

The service delivery solution that was deployed was designed to ensure that all the heavy lifting throughout the project lifecycle was done by the offshore team at the offshore Q Studios, with all the customer-facing activities being addressed by the onsite team. 
 
Some of the project deliverables included: 

  • The streamlining of project related updates and communications since the onsite team and our Client were both in the same time zone. 
  • The onsite team was responsible mainly for the review and second level quality control, which ensured faster turnaround since the obvious issues were audited and fixed by our offshore Q Studios team. 
  • The core delivery and repetitive testing tasks were done by the offshore Q Studios team, which reduced costs and flexibility to ramp up and down at short notice. 

A large percentage of the project delivery workload was handled by the offshore team and the onsite site team bridged the gap between the Client and offshore teams by being the liaison layer to mitigate any potential risk of miscommunication or delayed responses due time zone difference. 

Key benefits

  • A 40 – 45% reduction in costs was achieved since tour Client’s workload was reduced and delivered by our QStudios, which was in a more cost-effective location. 
  • A 35 – 40% productivity improvement was seen as a direct impact of the onsite-offshore model that increased output,tens of thousands of apps. 
  • A greater than 95% acceptance rate was achieved through the creation of an internal Quality Control process. 
  • Our Client benefitted from a highly scalable model with access to a large talent pool of highly skilled test analysts. 
  • The offshore delivery team was ramped up to full capacity within 1 – 2 weeks and was productive from week 3 onwards. 
quality engineering free assessment Download the PDF