Junior Databricks Platform Engineer

Overview

Junior Databricks Platform Engineer on Elanco's Data Storage team, supporting the operation, governance, reliability and optimization of the Databricks platform, with guidance from the Data Storage Tech Lead and experienced platform engineers.

What you'll do

• Support the day-to-day operation and maintenance of Databricks workspaces, compute, SQL warehouses and jobs.
• Monitor platform health, utilisation and workload performance, and investigate operational issues with guidance from experienced engineers.
• Support platform upgrades, configuration changes and adoption of new Databricks capabilities.
• Support the team's established IT Service Management (ITSM) processes by appropriately owning, tracking, updating, and closing incidents/service requests from stakeholders within the expected service levels.
• Troubleshoot platform, compute, job and workload issues, escalating complex issues to senior engineers when required.
• Support incident investigation, root-cause analysis and implementation of corrective actions.
• Maintain operational runbooks, documentation, monitoring and alerting with guidance from senior engineers.
• Support compute policies, tagging and other cost-management practices.
• Support automation of routine Databricks administration and operational activities.
• Develop and maintain scripts, tools and documentation that improve day-to-day platform operations.
• Work closely with Data Engineers to support reliable, secure and efficient Databricks workloads.

What you'll need

• 2–3 years of experience in data engineering, data platforms, cloud engineering or a related field.
• Hands-on experience with the Databricks platform through professional work, projects or production environments.
• Working knowledge of Apache Spark/PySpark and SQL.
• Basic understanding of Databricks platform operations, compute, jobs and SQL warehouses.
• Familiarity with Databricks Unity Catalog, permissions, identities and access controls.

Nice to have

• Exposure to cloud platforms such as AWS, Azure or GCP.
• Familiarity with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Key Vault, Azure Logic App, and Azure SQL Server.
• Familiarity with Git, CI/CD and basic automation practices.
• Good problem-solving and troubleshooting skills.
• Strong willingness to learn and develop platform engineering skills.

Details

• Location: India, Bangalore.
• Travel: 0%.