Platform Engineer

Overview

The Azure Data Platform Engineer will design, implement, and maintain Azure cloud data platforms and analytics solutions to support business objectives and digital transformation. The role focuses on managing data in Databricks Unity Catalog, developing data integration and transformation workflows, and implementing CI/CD pipelines.

What you'll do

• Design, deploy, and maintain Azure cloud infrastructure and data platform services, including Databricks, Storage Accounts, V-Net/Networking, SQL Servers, Function Apps, and API Management.
• Develop and maintain Infrastructure as Code using Terraform and Bicep for standardized and repeatable deployments across Development, Test, and Production environments.
• Build and maintain CI/CD pipelines using Azure DevOps, including Git repositories, branching strategies, release processes, and automated deployments.
• Support the configuration, administration, and operational management of Azure Databricks and associated platform components, including Unity Catalog and integration with Azure services.
• Develop automation and operational solutions using PowerShell, with working knowledge of Python and SQL for platform administration, deployment, and troubleshooting.
• Collaborate with data engineering, application, architecture, networking, and security teams to design and implement secure, scalable, and reliable cloud-based solutions.
• Implement DevOps, cloud security, configuration management, and change management best practices aligned with company IT architecture and security standards.
• Improve platform automation, reusable IaC libraries, technical documentation, operational procedures, and engineering best practices.
• Provide technical guidance to team members and stakeholders.

What you'll need

• A minimum of a bachelor's degree in an IT discipline or a minimum of 5 years of relevant experience.
• Recent experience designing and deploying in Microsoft Azure’s Environment.
• Ability to thrive in challenging situations and solve complex problems.
• Ability to manage own work effort in multiple projects with little supervision.
• Interest in emerging technologies and the ability to quickly learn and exploit cutting edge offerings to achieve business objectives.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Experience with Git and Azure DevOps Pipelines.
• Experience with Terraform and Bicep.
• Experience with PowerShell, with basic Python and SQL.
• Experience with Azure, including Databricks, Databricks Workspace, V-Net, Networking, Azure SQL Server, Function Apps, Storage Accounts, and API Management.
• Knowledge of Databricks Unity Catalog and Databricks platform concepts.
• Knowledge of CI/CD, repository structure, branching strategy, and deployment automation.
• Knowledge of cloud security, DevOps security, change management, and configuration management.

Nice to have

• Docker and Kubernetes.
• Microsoft Purview and Databricks Unity Catalog for data governance.
• Basic Python, SQL, and Apache Spark knowledge.
• Docker, Kubernetes, and Azure/DevOps security and governance concepts.

Details

• Location: Navi Mumbai, India; the selected candidate is expected to live a commutable distance from the IT Hub in Mumbai, India.
• The role allows employees to work remotely but requires onsite work based on project work and role needs.
• Onsite frequency is to be agreed upon by the employee and their leader.
• Relocation assistance is not available.