Big Data Engineer - India

Overview

Big Data Engineer/Data Engineer role with experience in data warehouse/lake projects and building end-to-end big data pipelines at petabyte scale.

What you'll do

• Implement multiple end-to-end data warehouse projects in a big data environment.
• Build complex data pipelines using Spark with Scala/Python/Java on Hadoop or object storage.
• Work with databases such as Oracle and Netezza and apply strong SQL.
• Create user stories with defined acceptance criteria in an Agile/Scrum framework.
• Participate in sprint planning as well as sprint reviews.

What you'll need

• 5+ years of experience in Data Warehouse/Data Lake/Lake House related projects.
• Experience in data engineering for product or service-based organizations.
• Expertise in end-to-end DW project implementation in big data environments handling petabyte scale data.
• Solid experience building complex data pipelines through Spark with Scala/Python/Java on Hadoop or object storage.
• Experience with databases like Oracle and Netezza and strong SQL knowledge.
• Agile/Scrum experience including creating user stories with acceptance criteria and participating in sprint planning and reviews.
• Strong verbal and written communication skills.

Nice to have

• Experience building NiFi pipelines.
• Analytical skills for debugging production issues, root cause analysis, and mitigation planning.

Details

• Location: Pune, Bengaluru, Gurugram, Chennai, Hyderabad, or Mumbai.