Our Client struggled to maintain the balance between the testing coverage of new application functionality and governmental regulations.
Calculations around estimated automated coverage of those regulations were unreliable due to a lack of consistent traceability between manual cases, automation scripts, and regulation requirement.
Finding and closing known gaps in test coverage and introducing enhancements to the current testing processes.
The conversion of uncovered regulations into manual tests and then automating existing automatable manual test cases in order to reach the desired automation coverage
Reduced potential project blockers by up to 60% and avoided delays while increasing testing quality and known metrics.
Increased the scalability aspects of multiple testing processes and practices by up to 80%.
Our Client is a highly advanced telematics and fleet management company, used by multiple organizations such as Walmart, to provide an easily managed fleet solution that adheres to all governmental regulations. Its app and website allow for both drivers and back-office employees to ensure shipments and deliveries run as smooth as possible.
More and more businesses are needing to meet the increased demand of goods being transported. Our Client offers a scalable solution to organizations in order ensure seamless fleet management so that businesses can find ease of mind regarding transportation and fleet logistics.
With a full suite of customizable apps and tools, their platform gives businesses the power to choose how they manage their fleet. With applications such as Hours of Service (HOS), Navigation, Telematics and more, there are many applications that can be bundled into a customized solution that fits the needs of any business.
Our Client’s HOS application has to be audited yearly or upon the release of a new Electronic Logging Device (ELD) to ensure compliance with regulations as set by respective countries that they operate in. Their software development engineers in test (SDETs) were struggling to maintain the balance between the testing coverage of new application functionality and governmental regulations. In addition, calculations around estimated automated coverage of those regulations were unreliable due to a lack of consistent traceability between manual cases, automation scripts, and regulation requirements.
These issues made it more difficult to estimate the impact to the quality assurance team’s bandwidth to support each upcoming audit. It also increased the risk of audit failure as it isn’t always known which batch of regulations will be in scope per audit.
Initially our Client’s engagement goals were to:
Qualitest implemented an iterative process model with two clear and well-defined phases:
Phase 1 – assess current coverage of regulations and the desired enhancements
We undertook deep dives and fact-finding excursions into the Client’s existing testing practices and coverage metrics. They gained a detailed understanding of frequently used processes and practices and at the end of this phase we were able to provide a detailed list of milestones and timelines to meet partner goals. Following this, we recommended an overhaul of the existing TestRail management tool use, firstly to enhance its ability to provide traceability via increased fields and labels for all templates currently used, and secondly to provide a method of data gathering via its Restful APIs to create accurate metrics over various aspects of the testing statuses.
Phase 2 – implement enhancements and increase coverage
In this phase, we split our time by covering known gaps in test coverage and introducing enhancements to the current test processes. Both teams worked together to build a strong sense of partnership and trust, and we took it upon ourselves to establish mutual success criteria and processes to alleviate the need for the micromanagement of tasks, as well as reduce bottlenecks and overhead for the existing SDETs.
While we worked on solidifying the enhanced processes, engineers were continuing to convert uncovered regulations into manual tests and then automate existing automatable manual test cases in order to reach the desired automation coverage.
In the middle of this timeline, a new feature outside of government regulations was needed through automation coverage. We worked side-by-side with our partner’s SDETs to successfully provide full coverage of the necessary tests while still being able to remain on track for the existing project timeline.
Download the PDF
