IBM China Development Lab

Reducing testing times by more than 90 percent

Published on 31-Jan-2013

"This automation cut our DevOps acceptance tests from 4-14 days to just 3 hours." - —Tung Diep, Program Director, IBM China Development Lab

Customer:
IBM China Development Lab

Industry:
Computer Services

Deployment country:
China

Solution:
SmartCloud - Foundation

Overview

The IBM China Development Lab today has more than 2,300 developers located in Beijing, Shanghai and Taipei and is among the top five largest development laboratories in IBM. The lab’s Zodiac test team provides product testing services to more than 300 developers and testers worldwide.

Business need:
In recent years, the IBM China Development Lab Zodiac team has watched the time allotted for testing to shrink. However, with its previous processes, it could take several weeks for staff to set up the testing environment.

Solution:
To reduce the software delivery cycle time and improve quality, the lab applied the DevOps principles and capabilities that today are delivered via IBM® SmartCloud™ Continuous Delivery software.

Benefits:
By automating the DevOps lifecycle, the IBM China Development Lab has reduced testing times by more than 90 percent and improved staff productivity.

Case Study

The IBM China Development Lab today has more than 2,300 developers located in Beijing, Shanghai and Taipei and is among the top five largest development laboratories in IBM. The lab’s Zodiac test team provides product testing services to more than 300 developers and testers worldwide.

The need
In recent years, the IBM China Development Lab Zodiac team has watched the time allotted for testing to shrink.

“We have an aggressive product development lifecycle—a ‘sprint’ cycle—where we need to setup environments and complete testing in less than three weeks,” says Tung Diep, program director, IBM China Development Lab.

However, Tung Diep says that the Zodiac testing team’s previous processes weren’t aligned to support this requirement. Development teams, which are spread across Italy, Canada, China and the United States, used email to describe and request new test environments. It could take up to a week for the team to finalize all required details via email. Additionally, operations staff had to manually set up each environment—a time-consuming process that was prone to error.

“Because of our previous processes, it took us several weeks just to set up the testing environment,” says Tung Diep.

The solution
To reduce the software delivery cycle time and improve quality, the lab applied the DevOps principles and capabilities that today are delivered via IBM® SmartCloud™ Continuous Delivery software.

The solution provides development, test and operations staff with templates to capture and share environment requirements. These templates are then stored as “patterns” for automated repeatable delivery of reliable test environments throughout the testing lifecycle. Workflow tasks were used to automate the testing cycle, including provisioning and deploying the software to test.

By combining IBM SmartCloud Continuous Delivery capabilities with Jenkins and Chef open source technologies, the team automated the deployment of Microsoft Windows, Linux and IBM z/OS® test environments with the push of a button.

The benefit
Automating the DevOps lifecycle enabled the IBM China Development Lab to improve time to market and testing quality while reducing costs. For example, through automated provisioning, the time to provision environments decreased from two days to just one hour—a 90 percent improvement—while the number of operators needed decreased by 50 percent (from 4 to 2 people).

“This automation cut our DevOps acceptance tests from 4-14 days to just 3 hours,” says Tung Diep. ”We’ve also reduced the time to recreate defects from 7 days to only 1 day—a more than 80 percent improvement. This approach has significantly improved end-to-end scenario stability and stands as a great reference for what a DevOps automated pipeline can do.”

Solution components

  • IBM® SmartCloud™ Continuous Delivery
  • Jenkins continuous integration server
  • Chef systems integration framework

For more information
To learn more about IBM SmartCloud solutions, please contact your IBM sales representative or IBM Business Partner, or visit the following website: ibm.com/cloud

Products and services used

IBM products and services that were used in this case study.

Software:
IBM SmartCloud Continuous Delivery

Legal Information

© Copyright IBM Corporation 2013 IBM Corporation Software Group Route 100 Somers, NY 10589 U.S.A. Produced in the United States of America February 2013 IBM, the IBM logo, ibm.com, SmartCloud and z/OS are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at “Copyright and trademark information” at ibm.com/legal/copytrade.shtml Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Microsoft and Windows are trademarks of Microsoft Corporation in the United States, other countries, or both. This document is current as of the initial date of publication and may be changed by IBM at any time. Not all offerings are available in every country in which IBM operates. The performance data and client examples cited are presented for illustrative purposes only. Actual performance results may vary depending on specific configurations and operating conditions. It is the user’s responsibility to evaluate and verify the operation of any other products or programs with IBM products and programs. THE INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS” WITHOUT ANY WARRANTY, EXPRESS OR IMPLIED, INCLUDING WITHOUT ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND ANY WARRANTY OR CONDITION OF NON-INFRINGEMENT. IBM products are warranted according to the terms and conditions of the agreements under which they are provided. GMC14023-USEN-00