Client overview

This industry-leading mixed reality (MR) company aimed to dominate the metaverse, integrating the real and digital worlds through VR and augmented reality (AR). It released a social MR platform where users can explore new places, play games, and build communities, all in line with its vision for virtual work and play. The company’s product release roadmap featured aggressive timelines and frequent updates.

Improving the testing of new features for shorter release cycles 

The product was released on multiple VR device platforms, requiring the Client’s quality assurance (QA) team to test new features and perform regression tests within shorter release cycles. This increasing workload, along with the need for manual user experience testing, had to be managed within budget constraints.

The QA team faced significant pressure to identify critical user-impacting bugs in new features while ensuring existing features remained bug-free. The short sprint cycles and long hours were causing burnout and affecting quality.

Introducing a global delivery model with multi-location offshore teams

To support our Client, Qualitest proposed a global delivery model that leveraged our highly skilled managed offshore teams in our remote Q Studio labs in India and Madagascar. The Qualitest team integrated with the Client’s QA teams to bolster the testing of new features, while our offshore team took on the end-to-end manual user experience testing. This ensured our Client’s onsite team experienced no extra burden. 

Qualitest’s Q Studios teams in India and Madagascar implemented the engagement in carefully planned phases, each with clear, achievable objectives. As each phase was completed, they smoothly transitioned to the next, ensuring continuous progress and success. 

Phase 1: Infrastructure and environment setup and onboarding 

In this initial phase, we focused on team training, lab setup, onboarding, and tool implementation. 

Phase 2: Discovery 

During this phase, we conducted analysis and planning, designed tests, and ran ad hoc testing as needed. Qualitest also created a project roadmap, defined the project scope, and identified assumptions and risks. 

Phase 3: Pilot 

Here we ran parallel execution executing specific test sections assigned by our Client’s QA lead. We tested features according to the roadmap and conducted ad hoc testing as an integral part of the testing cycle. 

Phase 4: Rollout 

In the final phase, we took full ownership of executing end-to-end manual testing, including calibrated multiuser manual user experience testing across locations. 

This delivery model offered several advantages: 

  • Seamless execution with minimal downtime: The readiness and stability of the test environment were maintained through coordination with our Client’s infrastructure team during offshore off hours, ensuring minimal downtime. 
  • Effective communication: Daily engagement with our client’s point of contact (POC) during onsite daytime hours was key to addressing priorities, concerns and changes of direction. This real-time communication allowed the offshore team to start its workday fully informed and eliminated the typical 12-hour lag in offline communication. 
  • Increased efficiency and speed: Critical time-sensitive test tasks were handed off to the offshore team by the client QA POC at the end of every day. These tasks were completed during the offshore team’s daytime, effectively creating a 16-hour workday through a follow-the-sun model, which boosted efficiency and the speed of delivery.

Key benefits

  • Qualitest’s innovative hybrid approach helped cut costs by 40-45% for our Client. Our manual user experience testing teams based at our offshore Q Studios lab in India and Madagascar, operated in lower-cost geography.  
  • We conducted multiple manual user experience testing sessions each day, averaging 20-30 end-user scenarios per session. This resulted in finding thousands of bugs that would have impacted end-users.
  • We executed hundreds of end-user scenarios, accumulating over 6000 hours of manual user experience testing.
  • Qualitest’s offshore teams reported bugs with greater than 80% uniqueness/validity, leading to actual product changes.
quality engineering free assessment