Associate Director, Data Engineering

Overview

Senior technical leadership role in data engineering at MSD, owning enterprise data pipeline architecture across IDMC, Databricks and AWS, and advising on the technical strategy for commercial and manufacturing analytics.

What you'll do

• Serve as a senior technical leader and key advisor for data engineering, partnering with Enterprise Architecture to co-create technical vision, data blueprints and engineering standards.
• Lead the design and implementation of highly complex, end-to-end data pipeline architectures using IDMC, Databricks and AWS to support global commercial and manufacturing analytics.
• Establish best-practice architectures for Databricks Lakehouses (Unity Catalog, Delta Lake optimization) and highly secure AWS infrastructures.
• Champion the architectural strategy for data replication, migration and synchronization between Salesforce (e.g., Salesforce Life Sciences Cloud, Veeva CRM) and downstream analytical platforms.
• Own the enterprise architecture for IDMC, defining patterns for secure agents, high-throughput mappings, reusable taskflows and hybrid cloud integration strategies.
• Collaborate with principal architects, product owners and commercial business leads to translate corporate objectives into robust, compliant and scalable technical solutions.
• Hold accountability for the technical compliance, data quality and security of delivered assets, ensuring adherence to SDLC software validation, privacy laws and security protocols.
• Spearhead technical exploration, prototyping and proof-of-concept initiatives for emerging trends such as real-time streaming, generative AI pipeline components and automated data quality monitoring.
• Mentor senior engineering talent and guide engineering squads, establishing a strong community of practice.

What you'll need

• Principal-level programming: mastery of programming languages and advanced SQL, with deep understanding of memory management, cluster configuration and query tuning in distributed systems.
• Demonstrated expertise in designing large-scale integration solutions using Informatica Intelligent Data Management Cloud (IDMC), including API management, performance tuning and Secure Agent architecture.
• Advanced experience structuring enterprise Lakehouses, managing global schema permissions via Unity Catalog, and optimizing read/write speeds using Delta Lake configurations.
• Proven track record of architecting high-volume synchronization processes from Salesforce/Veeva CRM to central warehouses while preserving performance and data integrity.
• Industry-leading expertise in dimensional modeling, data lake design patterns, Slowly Changing Dimensions (SCD) and semantic layer architecture.
• Solid understanding of data privacy frameworks, commercial compliance standards and SDLC validation workflows.
• Outstanding ability to communicate technical roadmaps, architectural risks and complex trade-offs to senior leadership and business stakeholders.

Nice to have

• Mastery in building serverless cloud architectures on AWS using Infrastructure as Code and orchestrating services such as S3, Lambda, IAM and Step Functions.

Details

• Location: Hyderabad (Hitec City Raidurg), India.
• Flexible work arrangement: Hybrid.
• Employee status: Regular.
• Relocation: Domestic.
• Visa sponsorship: No.
• Travel: No travel required.