Overview
Automation Test Engineer- GCP role focused on leading QA for complex data engineering pipelines on Google Cloud Platform.
What you'll do
- Define and maintain testing methodologies for the GCP data engineering stack (Dataflow, Dataproc, Cloud Run, BigQuery/dbt).
- Develop and execute data quality frameworks using dbt tests and external tools like Great Expectations and Soda Core.
- Implement integration and regression tests for ETL/ELT pipelines, including container- and HTTP-triggered tests for Cloud Run.
- Use emulators or dedicated test instances to test Spanner, Cloud SQL, and AlloyDB; validate stored procedures and functions with sample data.
- Orchestrate end-to-end pipeline tests via Cloud Composer/Apache Airflow or scripting.
- Embed QA into CI/CD pipelines and use IaC tools (Terraform, Deployment Manager) to provision reproducible test environments.
- Use Cloud Logging/Monitoring and observability tools (e.g., Elementary Data) to track health and anomalies.
What you'll need
- 5+ years in QA or software testing, including data pipelines/data warehouses.
- Proficient in complex SQL and writing data validation queries.
- Strong experience with GCP data tools: dbt, BigQuery, Dataflow, Dataproc, Cloud Run, Spanner, AlloyDB, Cloud SQL.
- Hands-on with data-quality frameworks: Great Expectations, Soda Core, dbt-utils, dbt-expectations.
- CI/CD automation experience (Jenkins, GitLab CI, GitHub Actions).
- Skilled in scripting languages (Python, pytest).
- Excellent communication and mentoring ability.
Details
Read the full description and apply on the company’s own careers page.
