Data Engineer II

Overview

Data Engineer II to design, build, and scale data platforms powering analytics and product use cases, with a focus on pipelines, infrastructure optimization, and strong data quality and governance.

What you'll do

• Design and maintain scalable batch and real-time data pipelines for ingesting, transforming, and loading data.
• Integrate data from diverse sources while ensuring reliability, scalability, and efficiency.
• Design and implement data models, warehouse schemas, and tables for analytics and reporting.
• Manage and optimize data platform infrastructure including Spark, Snowflake, Kafka, Airflow, and Kubernetes.
• Implement validation, automated testing, monitoring, and alerting for data freshness, accuracy, and completeness.
• Enforce data governance standards such as access controls, data lineage, and compliance, including secure handling of PII.
• Optimize queries, partitioning, file formats, and compute resources to improve performance and manage infrastructure costs.
• Develop CI/CD pipelines for data workflows and build reusable automation frameworks.

What you'll need

• 5–8 years of experience in data engineering or a related field.
• Strong programming skills in Python, Scala, or Java.
• Advanced proficiency in SQL and data modeling concepts.
• Hands-on experience with Apache Spark.
• Hands-on experience with Snowflake or similar cloud data warehouses.
• Hands-on experience with Kafka or other streaming platforms.
• Hands-on experience with Airflow or similar orchestration tools and Kubernetes.

Details

• Job title: Data Engineer II.