Data & AI Platform Engineer II, Commercialization

Overview

The Data & AI Platform Engineer II will help build and operate the Databricks and Unity Catalog platform infrastructure underpinning the Commercial Data & AI HYD team's data products, ensuring reliability, security, and readiness for new Commercial AI initiatives.

What you'll do

• Build, configure, and operate Databricks and Unity Catalog platform components supporting the team's data products, including workspace, cluster, and access configuration.
• Manage cloud engineering tasks for the platform, including provisioning, cost management, and performance tuning of the underlying cloud infrastructure.
• Coordinate with Enterprise IT on systems integration and feature enablement, supporting rollout of new platform capabilities to the team.
• Partner with Enterprise IT and the team's data architects on platform architecture standards, ensuring configuration stays aligned with enterprise-wide direction.
• Support platform reliability and security by implementing access controls, monitoring, and configuration management for the Databricks environment.
• Troubleshoot platform-level issues affecting pipeline execution, working with data engineers to isolate platform versus pipeline-specific issues.
• Validate that newly migrated infrastructure meets performance and reliability requirements before cutover to production use.
• Document platform configuration, access patterns, and operational runbooks to support consistent operations across the team.

What you'll need

• Working proficiency in SQL and Python for platform automation and configuration scripting.
• Hands-on experience with Databricks platform administration (workspace configuration, clusters, jobs, Unity Catalog) and Delta Lake concepts.
• Experience with cloud infrastructure fundamentals (e.g., AWS storage, compute, networking, and IAM concepts) relevant to a Databricks deployment.
• Understanding of access control, security, and compliance considerations for a shared data platform handling sensitive commercial pharma data.
• Familiarity with infrastructure-as-code or configuration management approaches for reproducible platform setup.
• Working knowledge of software engineering practices including Git/version control, code reviews, and CI/CD concepts.
• Good troubleshooting and cross-team communication skills, with the ability to work effectively with both data engineers and Enterprise IT.
• Understanding of data governance and secure data handling practices, including access controls and protection of sensitive data.

Details

• Location: Hyderabad, Telangana, India.
• Work model is assigned based on core responsibilities (site-essential, site-by-design, field-based or remote-by-design); the ad does not state the specific model for this role.