Data Engineer II (Data Warehouse, Big Data, Spark with Scala/Python/Java on Hadoop, Oracle/SQL)

Overview

The Enterprise Data Solutions team is looking for a Big Data Engineer to unlock the potential of data assets by innovating, eliminating friction in how users access data from Big Data repositories, and enforcing standards and principles in the Big Data space.

What you'll do

• Develop high quality, secure and scalable data pipelines using Spark and Scala/Python on Hadoop or object storage.
• Leverage new technologies and approaches to innovate with increasingly large data sets.
• Drive automation and efficiency in data ingestion, data movement and data access workflows through innovation and collaboration.
• Contribute ideas to ensure required standards and processes are in place, and look for opportunities to enhance standards and improve process efficiency.
• Perform assigned tasks and support production incidents.

What you'll need

• 3-5 years of overall career experience in Data Warehouse related projects in a product or service-based organization.
• Expertise in Data Engineering and implementing multiple end-to-end DW projects in a Big Data environment.
• Experience building data pipelines through Spark with Scala/Python/Java on Hadoop or object storage.
• Experience working with databases like Oracle and Netezza, and strong SQL knowledge.
• Strong analytical skills for debugging production issues, providing root cause and implementing mitigation plans.
• Strong verbal and written communication skills.
• High-energy, detail-oriented, proactive, able to function under pressure in an independent environment, with a high degree of initiative and self-motivation to drive results.
• Flexibility to work as a member of matrix-based, diverse and geographically distributed project teams.

Nice to have

• Experience working on Nifi.

Details

• Location: Pune, India.