Senior Engineer - Data

Overview

Senior Data Engineer role focused on building and operationalizing data engineering solutions on Microsoft Azure.

What you'll do

• Build and operationalize data solutions for business using Azure services and custom solutions.
• Migrate on-premise data warehouses to Azure cloud data platforms.
• Design and implement data engineering, ingestion, and transformation workflows using ADF and Databricks.
• Develop Python-based APIs on Azure Function Apps.
• Build and tune data pipelines for capacity planning and performance on ADF and Databricks.
• Collaborate with business stakeholders for requirement gathering and query resolution.

What you'll need

• 4-7 years of overall experience in Azure Data Engineering.
• Proficiency in PySpark.
• Experience with Azure Data Factory, Azure Data Lake Gen2, and Azure SQL.
• Experience with Azure DevOps, including CI/CD pipelines for data services.
• Understanding of data masking, encryption, and handling sensitive data.
• Exposure across the SDLC including testing and deployment.
• Graduate or post-graduate education; preferably in relevant fields (e.g., Computer Science, Statistics, Mathematics, Data Science, Engineering).

Nice to have

• Knowledge on Apigee (Google's API Management).
• Microsoft Azure certification.

Details

• Location: Pune.