Data Engineer II

Overview

Data Engineer II responsible for delivering data engineering pipelines and solutions through the Enterprise Data Platform for multiple groups and divisions.

What you'll do

• Perform source-to-target data analysis and mappings.
• Build, test, and optimize real-time and batch data pipelines.
• Collaborate with administrators, developers, data engineers, and analysts on solution delivery.
• Analyze requirements and coordinate delivery with project managers and development teams.
• Support backlog management and sprint planning with the scrum master.
• Help evolve data platform architecture and roadmap initiatives.
• Ensure data quality and integrity across data warehouses and AWS platforms.

What you'll need

• 4+ years of overall work experience.
• 3+ years of experience delivering data solutions.
• 2+ years building cloud BI solutions using AWS or Azure.
• 4+ years programming in SQL, PySpark, and Python.
• Experience with agile, DevOps, DataOps, and DevSecOps practices.
• Strong analysis, requirements documentation, communication, prioritization, and problem-solving skills.
• Knowledge of GPT, large language models, and retrieval-augmented generation.

Nice to have

• Experience with Snowflake or Azure data engineering.
• Knowledge of PostgreSQL, MySQL, MongoDB, or Cassandra.
• Experience building pipelines in Databricks.
• Experience with Power BI or Tableau.
• Knowledge of data governance, quality, and security practices.
• Relevant cloud data engineering certifications.
• Basic understanding of machine learning and generative AI.

Details

• Location: Bangalore, India.
• Work schedule: Standard Monday to Friday.
• Work environment: Office.