Overview
Senior Data Engineer to design, build, and scale cloud lakehouse data products that power analytics, reporting, and AI/ML across Illumina.
What you'll do
- Partner with business, AI, and platform teams to translate domain needs into governed data products.
- Build end-to-end data products on Databricks, interoperating with Snowflake, from ingestion to analytics-ready datasets.
- Create reusable Python frameworks and standardized patterns for ingestion, transformation, validation, and publishing.
- Design relational/dimensional/lakehouse data models and build performant distributed data pipelines using Spark and Delta Lake/open table formats.
- Embed data quality, reconciliation, validation, and governance into pipelines, including Unity Catalog controls.
- Act as a technical leader by setting standards, leading code reviews, mentoring engineers, and contributing to architecture decisions.
What you'll need
- 8+ years of professional data engineering experience building and scaling data products on cloud platforms such as Databricks and/or Snowflake.
- Strong proficiency in Python, including reusable framework development using functional and object-oriented programming.
- Advanced SQL and strong data modeling skills across relational, dimensional, and lakehouse models.
- Solid understanding of distributed systems and system design for large-scale data processing.
- Hands-on experience with open table formats (Delta Lake and/or Apache Iceberg) and Parquet.
- Experience with Spark and modern ELT tooling such as dbt.
- Experience with data observability, governance, security, and compliance practices including RBAC, PII, and SOX.
- Solid software engineering foundation including Git, REST APIs, JSON, and CI/CD on at least one cloud environment (AWS preferred).
- Ability to work across business, AI, and platform teams with strong written and verbal communication skills.
- Bachelor’s degree in Computer Science, Data Science, Information Systems, Engineering, Mathematics, or related field, or equivalent experience.
Details
- Hands-on senior individual-contributor role with end-to-end ownership and leadership across multiple domains.
- Mentoring engineers on a global (India-based) team is included.
- Position is not eligible for visa sponsorship.
Read the full description and apply on the company’s own careers page.
