Principal Data Engineer

Overview

Principal Data Engineer to lead the design, architecture, and implementation of enterprise-scale data platforms for R&D, Clinical, Regulatory, Commercial, and Enterprise Analytics.

What you'll do

• Lead architecture, design, and implementation of enterprise data platforms on Databricks and AWS.
• Define and govern enterprise data engineering standards and reusable frameworks.
• Design scalable Lakehouse architectures using Delta Lake, Unity Catalog, and Databricks Workflows.
• Build batch and streaming data pipelines using PySpark and Spark SQL.
• Implement DataOps/CI-CD pipelines and automated testing for data platforms.
• Establish data quality, lineage, governance, and compliance practices.
• Provide technical leadership and mentor engineering teams across programs.

What you'll need

• 12+ years of experience in Data Engineering, Big Data, Data Platforms, or Cloud Engineering.
• 4 to 5 years of experience architecting enterprise-scale data solutions on Databricks/AWS.
• Experience with Databricks, Delta Lake, Unity Catalog, Spark, and PySpark SQL.
• Advanced Python development and software engineering practices.
• Expertise in CI/CD implementation and Git-based development practices.
• Experience implementing automated unit testing and quality assurance frameworks.
• Experience with Infrastructure as Code using Terraform/CloudFormation or AWS CDK.

Details

• Location: Bengaluru, India.
• Employment type: Full time regular employee.