For details on any topic above, visit:
QuerySurge Knowledge Base.
It’s our official online support and documentation hub, providing comprehensive, searchable resources to help users configure, manage, and optimize QuerySurge.
A Modern Architecture for
Continuous Data Validation
Deployed entirely within your infrastructure,
QuerySurge ensures your data stays protected
while running tests at enterprise scale.
QuerySurge Product Architecture
Secure. Scalable. Purpose-Built for Data Validation.
QuerySurge is an enterprise-grade data validation and ETL testing solution designed to run entirely within your environment — on-premises, virtualized, or in private cloud.
Your data never leaves your infrastructure, ensuring complete control and compliance.
(To expand the sections below, click on the +)
- Core Architecture
- Users, Projects, and Access Control
- Flexible Deployment Options
- Operating Systems and Requirements
- Connectivity Across the Data Landscape
- Enterprise-Level Security
- Enhanced Integration and Optimization
Core Architecture
QuerySurge’s Web architecture is built around three key components:
- Application Server: The central hub that manages user sessions, authentication, scheduling, and coordination across all components.
- Database Server: A built-in managed repository that stores tests, results, and comparisons - no separate database setup required.
- Agents: Execute queries against your source and target systems via JDBC. Add more Agents to scale throughput and handle high-volume testing across data warehouses, lakes, and files.
Users, Projects, and Access Control
Accessible through modern browsers, QuerySurge provides secure, role-based access:
- Admins: Full configuration, scheduling, reporting, and management.
- Full Users: Create, run, and monitor tests, export data, and view reports.
- Participant Users: Read-only access to results and reports.
Projects isolate assets, results, and connections so that multiple teams can share one instance without cross-visibility.
Flexible Deployment Options
Install QuerySurge on a single server or distribute components across multiple machines to scale performance.
- Single-Server Setup: Ideal for small teams or proof-of-concept deployments.
- Multi-Server Setup: Designed for enterprise data volumes and distributed teams.
- Dockerize Agents: Deploy multiple Agents on a single Docker instance for efficient parallel execution.
Operating Systems and Requirements
- QuerySurge supports Windows and Linux (Red Hat, Fedora) environments, on physical servers, VMs, or in a private cloud.
- For optimal performance, utilize an SSD storage and allocate ample CPU and RAM, especially for large datasets.
Connectivity Across the Data Landscape
QuerySurge connects to 200+ data sources, including:
- Data Warehouses
- Big Data lakes (Hadoop and NoSQL)
- Relational Databases
- Business Intelligence reports
- JSON files
- Excel
- Flat files (tab and delimited)
- Parquet files
- APIs
- XML
- others
Enterprise-Level Security
- Data Security: Database passwords and credentials are stored and transmitted with AES 256-bit encryption
- LDAP / LDAPS : QuerySurge deploys with Lightweight Directory Access Protocol (LDAP) authentication option & now supports LDAPS (Secure LDAP) authentication.
- TLS support: QuerySurge now supports TLSv1.0, TLSv1.1 and TLSv1.2 for HTTP communications between QuerySurge components.
- Kerberos: QuerySurge supports integration with Kerberos’ security mechanisms
- HTTPS/SSL: QuerySurge supports optional HTTPS/SSL deployment
- Single Sign-On (SSO) support: Current support for Okta, Azure Active Directory, Google Cloud, and Ping Identity.
Enhanced Integration and Optimization
- DevOps & RESTful APIs: Embed QuerySurge into CI/CD pipelines and dynamically create, execute, and update data validation tests utilizing 60+ API calls and integrate with other solutions in your DevOps pipeline.
- Webhooks: QuerySurge supports webhooks, providing real-time integrations with your DevOps, CI/CD, and alerting tools.
- Stats Monitor: Continuously tracks system performance and alerts you to memory, CPU, or disk thresholds for proactive optimization.
