ETL / Big Data Developer (Hadoop, Scala)– Home Loan Savings, VP

Overview

VP-level ETL / Big Data Developer role focused on designing, developing, and maintaining large-scale data processing pipelines for a home loan savings business.

What you'll do

• Design and implement robust, scalable ETL processes to ingest, transform, and load large datasets.
• Optimize ETL jobs for performance, scalability, and data quality.
• Build and maintain Hadoop ecosystem data pipelines (including HDFS, Spark, Hive, Impala, Kafka, Oozie).
• Leverage Spark with Scala to perform complex transformations and analytical computations.
• Use ServiceNow for incident, problem, and change management, including ticket creation and resolution.
• Implement data quality checks and validation rules, and align with governance, security, and regulatory requirements.

What you'll need

• 5-8 years of hands-on experience in data engineering, ETL development, or Big Data roles.
• Proficiency with ServiceNow for Incident, Problem, and Change Management.
• Expert-level Scala programming proficiency for data processing and Spark jobs.
• Extensive hands-on experience with the Hadoop ecosystem, including HDFS, Spark (Spark SQL/Streaming), and Hive.
• Experience designing and implementing complex ETL processes for large-scale data environments.
• Proficiency in SQL for data manipulation and analysis.

Details

• Location: Pune, India.