Senior Data Engineer, Data Engineering

Overview

Senior Data Engineer responsible for data unification/curation and building solutions that provide a unified view of data from multiple sources.

What you'll do

• Perform data ingestion, aggregation, and processing to enable insights.
• Use platforms such as Cloudera (CDE/CAI), Databricks, and AWS to deliver data engineering solutions.
• Partner with product, data science, platform strategy, and technology teams on data requirements.
• Manipulate and analyze complex, high-volume, high-dimensionality data from multiple sources.
• Identify and deliver proof of concepts/prototypes for current and future needs.
• Integrate new data assets and analyze transaction/product data to generate actionable insights.

What you'll need

• Good understanding of Python including Pandas, Numpy, PySpark, and Impala.
• Experience with data analysis, development, and testing on Hadoop and Databricks.
• Strong SQL and higher-level programming with knowledge of data mining and machine learning algorithms/tools.
• Hands-on data modeling, querying, data mining, and report development for business intelligence.
• Ability to understand complex operational systems and analytics/business intelligence tools for global users.
• Ability to work in a fast-paced, deadline-driven environment as an individual contributor and team member.

Details

• Location: Pune, India.