Lead Data Engineer

Overview

Lead Data Engineer role focused on designing and delivering a cloud-native healthcare data platform using AWS and modern data engineering tooling.

What you'll do

• Lead complex data engineering initiatives across multiple teams.
• Drive technical execution from design through production deployment.
• Establish scalable implementation patterns for data solutions.
• Design and implement batch and near-real-time data pipelines.
• Implement data quality frameworks and observability/monitoring practices.
• Lead Apache Iceberg implementation and optimization.
• Review architectures, conduct code/engineering reviews, and mentor engineers.

What you'll need

• 8–12 years of data engineering experience.
• Experience leading enterprise-scale data initiatives.
• Experience with AWS (S3, Glue, Athena, Lake Formation).
• Experience with IAM and security controls.
• Ability to work with Python, SQL, and PySpark/Spark.
• Knowledge of information practices for information security activities.
• Experience with schema evolution, partitioning, compaction, and metadata management standards.