Java PySpark Bigdata Developer

Overview

Intermediate Applications Development role focused on analyzing and programming application systems with a big data emphasis.

What you'll do

• Design, develop, and optimize scalable ETL data pipelines using PySpark.
• Write clean, efficient, well-documented code in Python (PySpark) and Java.
• Collaborate with cross-functional teams to understand data requirements and integration needs.
• Debug and resolve Spark data processing issues and performance bottlenecks.
• Participate in the full SDLC from requirements and design through testing, deployment, and operations.
• Ensure data quality and integrity across the data lifecycle.

What you'll need

• 4–8 years of relevant experience in the Financial Services industry.
• Strong Core Java and OOP concepts.
• Proficiency in Python and Java for PySpark development.
• Hands-on familiarity with Apache Spark (PySpark) and Hadoop; includes Hive and Sqoop.
• Knowledge of Linux OS and hands-on shell scripting.
• Basic SQL knowledge and experience writing queries to validate and manipulate data.
• Familiarity with AWS, Azure, or GCP.

Details

• Location: Pune, Maharashtra, India.
• Employment type: Full time.