Sr Data Engineer

Overview

Senior Data Engineer to design, build, and scale cloud lakehouse data products that power analytics, reporting, and AI/ML across Illumina.

What you'll do

• Partner with business, AI, and platform teams to translate domain needs into governed data products.
• Build end-to-end data products on Databricks, interoperating with Snowflake, from ingestion to analytics-ready datasets.
• Create reusable Python frameworks and standardized patterns for ingestion, transformation, validation, and publishing.
• Design relational/dimensional/lakehouse data models and build performant distributed data pipelines using Spark and Delta Lake/open table formats.
• Embed data quality, reconciliation, validation, and governance into pipelines, including Unity Catalog controls.
• Act as a technical leader by setting standards, leading code reviews, mentoring engineers, and contributing to architecture decisions.

What you'll need

• 8+ years of professional data engineering experience building and scaling data products on cloud platforms such as Databricks and/or Snowflake.
• Strong proficiency in Python, including reusable framework development using functional and object-oriented programming.
• Advanced SQL and strong data modeling skills across relational, dimensional, and lakehouse models.
• Solid understanding of distributed systems and system design for large-scale data processing.
• Hands-on experience with open table formats (Delta Lake and/or Apache Iceberg) and Parquet.
• Experience with Spark and modern ELT tooling such as dbt.
• Experience with data observability, governance, security, and compliance practices including RBAC, PII, and SOX.
• Solid software engineering foundation including Git, REST APIs, JSON, and CI/CD on at least one cloud environment (AWS preferred).
• Ability to work across business, AI, and platform teams with strong written and verbal communication skills.
• Bachelor’s degree in Computer Science, Data Science, Information Systems, Engineering, Mathematics, or related field, or equivalent experience.

Details

• Hands-on senior individual-contributor role with end-to-end ownership and leadership across multiple domains.
• Mentoring engineers on a global (India-based) team is included.
• Position is not eligible for visa sponsorship.