Big Data Engineer - Python and Spark

Overview

Data/Information Management Analyst trainee role focused on applying technical knowledge to analyze factual information and resolve assigned problems.

What you'll do

• Carry out assigned tasks using a range of processes, procedures, and systems.
• Make evaluative judgments based on analysis of factual information.
• Resolve problems by selecting solutions using acquired technical experience, guided by precedents.
• Exchange information concisely and adapt communication to audience diversity.
• Develop best-in-class code by redesigning costly compute and data processes.
• Work with large and multiple datasets and data warehouses to pull data via relevant programs and coding.

What you'll need

• Engineering degree (Bachelors/University degree or equivalent experience).
• 1-3 years of experience in BigData systems and Hive, Hadoop, and Spark (Python/Scala).
• Hands-on experience with Unix scripting, Python and Scala programming.
• Strong experience in SQL.
• At least 3 years of experience designing software systems with intense computational needs across real time and batch processing.
• Knowledge of supervised and unsupervised machine learning techniques.
• Confidence with data preprocessing and application engineering skills.

Details

• Location: Pune, Maharashtra, India.