Data Engineer II

Overview

Data Engineer II builds and maintains batch and streaming data pipelines and data warehouse/data model schemas, with an emphasis on data quality, governance, and compliance (HIPAA).

What you’ll do

• Build and maintain batch and streaming data pipelines for correct, on-time data delivery.
• Implement dimensional data models and dbt transformations based on an agreed design.
• Add data quality tests, monitors, and alerts for owned pipelines and respond when they fire.
• Apply HIPAA and PII patterns for member data, including access control, tagging, and audit trails.
• Diagnose and tune slow or expensive pipelines and queries, reporting measured improvements.
• Support stakeholders and data scientists using first-party and third-party data by answering questions about the models.
• Participate in on-call rotation and write/improve runbooks for failures you fix.

What you’ll need

• 3+ years of data engineering experience.
• 2+ years processing and storing large-scale data with distributed systems plus knowledge of data warehousing (star and snowflake schemas).
• 2+ years working with OLTP and OLAP data stores, including PostgreSQL/MySQL/MongoDB/Redis and Databricks/Snowflake/Redshift.
• 1+ years building data pipelines using Spark, Kafka, and Airflow.
• 1+ years designing/implementing data warehouse models (STAR/Snowflake) and developing ELT/ETL pipelines within data lake ecosystems.
• Bachelor’s degree in Computer Science or a related technical degree.
• Mastery of SQL and Python is preferred.

Nice to have

• Working knowledge of IAC like Terraform.
• 1+ year experience working with dbt.
• Knowledge of streaming systems like Flink, Kafka streams, or spark streaming.
• Experience with managed data integration platforms like Fivetran or Estuary.
• Experience with AI technologies.
• Excellent verbal and written communication skills.

Details

• Hybrid model: required to be in the office 3 days/week.
• Bengaluru-based role with regular interaction with colleagues in San Francisco, CA.
• Hours open to late-evening meetings in India Standard Time to align with 8am–6pm PT.