Success Story
Expleo Automates Data Migration Testing
for a leading UAE bank with QuerySurge
Expleo Automates Data Migration Testing
for a leading UAE bank with QuerySurge
Summary
The bank embarked on a critical data migration project to transition its database infrastructure from Informix to Oracle. Faced with the challenge of validating large volumes of data manually, the bank turned to Expleo for its guidance. By implementing QuerySurge, an automated data testing tool, Expleo supported the bank to accelerate testing , ensure data accuracy and integrity, and achieve substantial cost savings, resulting in an impressive ROI of approximately 180%.
Background
The bank’s move from a legacy Informix database to Oracle was part of a broader strategy to enhance operational efficiency and data management capabilities . Given the complexity and scale of the migration, the bank enlisted Expleo’s expertise to design and implement a robust data validation strategy capable of managing large data volumes with speed and accuracy.
Challenges
The bank initially relied on manual testing methods, such as Excel Macros and minus queries, to validate the migrated data. However, these methods presented significant challenges:
- Time-Consuming Processes: Manual validation was slow, particularly when dealing with millions of data points, creating bottlenecks in the project timeline.
- High Risk of Errors: The complexity and volume of data increased the likelihood of undetected discrepancies, potentially compromising data integrity.
- Resource Intensive: Manual processes required significant manpower and time, leading to increased costs and delays.
Solution
To address these challenges, Expleo recommended and implemented QuerySurge, a smart data testing solution designed to simplify and accelerate complex data migrations.
Expleo worked closely with the bank to devise a tailored strategy that leveraged QuerySurge to automate the validation of large data sets. The implementation involved:
- Automation at Scale: 6,000 QueryPairs (Source to Target Verifications) were created and scheduled to run overnight, accelerating the testing process without the need for manual intervention.
- Actionable Insights: QuerySurge’s advanced reporting and analytics capabilities allowed the bank to quickly identify and address any data discrepancies, ensuring the integrity of the migrated data.
- Tailored Support: Expleo’s expertise not only streamlined the testing process but also enhanced the overall efficiency and accuracy of the migration.
| Average Table Size Validated | 1 GB |
| Largest Table Size Validated | 620 Million Records |
| Total Tests Created | 6,000 QueryPairs |
| QuerySurge System Specifications | |
|---|---|
| Processor Cores | 4 |
| RAM | 128 GB |
| Number of Agents | 7 |
Benefits
Expleo’s expertise in data migration and the implementation of QuerySurge brought significant benefits to the customer, including:
- Accelerated Testing Cycle: Data validation time was reduced by 50%, from 7,000 hours to 3,500 hours, ensuring the project met tight deadlines.
- Enhanced Data Accuracy: Expleo’s strategic use of QuerySurge minimized the risk of human error, ensuring high data quality and integrity throughout the migration process.
- Cost Savings: Automation led to cost savings of approximately $131,200, driving an ROI of 180%.
- Improved Efficiency: Implementation of QuerySurge enabled the efficient handling and validation of 620 million data points, freeing up resources for other critical tasks.
QuerySurge allowed for easy identification of discrepancies between the source and target data. Its capability to execute multiple tests in parallel was crucial in saving time and enhancing overall efficiency.
About Expleo:
Expleo is a global engineering, technology and consulting service provider that partners with leading organisations to guide them through their business transformation, helping them achieve operational excellence and future-proof their businesses. Expleo benefits from more than 50 years of experience developing complex products, optimising manufacturing processes, and ensuring the quality of information systems. Leveraging its deep sector knowledge and wide-ranging expertise in fields including AI engineering, digitalisation, hyperautomation, cybersecurity and data science, the group’s mission is to fast-track innovation through each step of the value chain. As a responsible and diverse organisation, Expleo is committed to doing business with integrity and working towards a more sustainable and secure society. Expleo boasts an extensive global footprint, powered by 18,000 highly skilled experts delivering value in 29 countries.
About RTTS & QuerySurge:
RTTS, the developer of QuerySurge, is the premier pure-play QA & Testing organization that specializes in test automation. Headquartered in New York, RTTS has had 1,000+ successful engagements at over 700 corporations since 1996.
QuerySurge is RTTS’ smart data testing solution that automates the data validation and ETL testing of Big Data, Data Warehouses, Business Intelligence Reports and Enterprise Applications with full DevOps/DataOps functionality for continuous testing.
