Insights Blog Qualitest Enables Continuous Testing for Global Banking Leader with Codeless Automation and Agile

Case Study

Qualitest Enables Continuous Testing for Global Banking Leader with Codeless Automation and Agile

The transformation process led by the Qualitest team stabilized, monitored and implemented codeless innovation for the Client and helped them optimize full Agile capabilities.

Overview
Challenges

Convert manual testing to automated for faster time to market.

Deploy Agile practices to increase test coverage and speed up delivery of analytic results.

Solutions

Deployed codeless automation framework and a new CI infrastructure.

Optimized Agile/DevOps capabilities, including real-time analytics, KPIs, reporting process.

Results

Increased automated test coverage 4x and saved $600,000 in cost of labor.

Reduced analytic results deployment from 1 day to 1 hour.

Client Overview

Since its founding a century ago, the Client has developed an extensive network of branches and commercial banking activities across all areas of banking and is now one of the largest banks in Israel. The bank operates in all areas of banking and in associated activity in the capital market through three main divisions: corporate banking, retail banking, and financial markets & international banking.

In addition to its activities in Israel, the Client operates overseas and maintains connections with banks around the world.

Banking on Agile for Better Business Outcomes

For some time, the Client had been focusing on transforming from Waterfall to Agile methods to improve their DevOps and organizational processes. They wanted to implement a codeless automation framework to speed up time to market and increase test coverage, and they needed a partner who understood their industry and business rationale and could deploy Agile methods.

Qualitest had provided the bank a wide range of business assurance services for a decade, deploying over 400 projects dealing with manual testing, automation and infrastructure. We stepped in to lead their transformation effort.

A Three-Step Path to an Agile, Automated Transformation

We structured the project in three clearly defined phases:

Phase 1: Convert testing from Waterfall to Agile

We first established an Agile testing operation to deal with small changes in development for the Client’s multiple channels (web, mobile, legacy). This would also provide a real shift-left ability on new features testing plan deployment from the marketing/R&D requirements in every channel in a short time.

We advised that all manual testers and automation developers be integrated into the development teams for every channel as a professional squad. We also prioritized syncing and working all test plans to the internal tool development teams as an operation and not as a separate process, as it had been with Waterfall.

Phase 2: Enable Continuous Testing with a new CI infrastructure

Next we implemented a new CI infrastructure and pipeline to enable a stable continuous testing process and allow us to monitor and map results in detail.

Mapping the failures state would shorten the analytics time frame and enable the separation and pushing of issues to the right teams for a fast fix.

Phase 3: Deploy codeless automation framework

In Agile methodologies, it is important to deal with all product layers from the bottom up. This true shift-left methodology lets quality engineers decrease testing cycles, catch issues as soon as possible and fix them quickly.

The codeless automation framework that Qualitest deployed enabled automation testing of all system layers (except unit testing), simultaneously allowing automation efforts to accelerate dramatically. In the final phase, our codeless automation framework was implemented and began quickly generating automated tests in every layer—component, integration, API, GUI.

An additional benefit of the test framework is that it enabled testing of APIs for which limited or no documentation existed, transforming a testing gap into a fully tested asset.

Key Benefits

The transformation process led by the Qualitest team stabilized, monitored and implemented codeless innovation for the Client and helped them optimize full Agile capabilities.

 

  • Through upgrading to codeless automation, testers were able to execute four times as many test cases a day.
  • The capability to map the failures state shortened the analytics time from 9 hours to 1 hour per nightly automation run.
  • We were able to generate 5,000 automatic test cases for 2,000 API services in a month, with no manual testing.
  • The conversion from manual testing saved the Client $600,000 in manpower costs.
  • The execution success rate increased from 20% to 85% on every nightly build.
download the pdf