Data Engineer

Overview

Design, develop and maintain data solutions for data generation, collection, and processing, including data pipelines, data quality and ETL processes to migrate and deploy data across systems.

What you'll do

• Design and build data foundations and end-to-end data solutions for the business.
• Create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems.
• Collaborate with cross-functional teams to understand data requirements and provide solutions that enhance data accessibility and usability.
• Mentor junior engineers and act as subject matter expert on data analysis and design.
• Convert vision and data strategy into IT solutions and deliver them.
• Drive the roll-out and embedding of data foundation initiatives in support of key business programmes.
• Coordinate change management, incident management and problem management processes.
• Present reports and findings to key stakeholders.
• Drive implementation efficiency and effectiveness across pilots and future projects.
• Contribute to community building initiatives such as CoE and CoP.

What you'll need

• Minimum 7.5 years of experience in Microsoft Azure Databricks.
• 15 years full time education.
• Master ELT.
• Master data modeling.
• Master data integration and ingestion.
• Skill in data manipulation and processing.
• Skill in GitHub, Actions and Azure DevOps.
• Skill in Data Factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis and Redshift.
• Proficiency in Microsoft Azure Databricks.
• Strong understanding of data modeling concepts and best practices.
• Familiarity with data governance and compliance standards.
• Experience in programming languages such as Python or Scala for data processing.
• AWS/Azure/SAP experience.

Nice to have

• Experience with data warehousing solutions.

Details

• Based at the Bengaluru office.
• Full-time role.