Lead Data Engineer 4C

Overview

Lead a team of data engineers in building and deploying Big Data solutions, with a focus on scalable data pipelines, ETL processes and data quality.

What you'll do

• Lead a team of data engineers in developing and implementing Big Data solutions
• Design and build scalable and reliable data pipelines and ETL processes
• Ensure data quality, integrity, and security across all data systems
• Collaborate with stakeholders to understand and address business requirements
• Provide technical guidance and mentorship to junior team members
• Stay current with industry trends and technologies related to Big Data and data engineering
• Perform data analysis and troubleshooting to optimize system performance and efficiency
• Develop and maintain documentation for data processes, systems, and infrastructure

What you'll need

• Bachelor's in Computer Science, Data Science or Statistics, or Master's in Data Science
• Certifications: Certified Data Management Professional (Riversand); Databricks Certified Associate Developer for Apache Spark 3.0 or Apache Spark (Databricks Academy); Microsoft Certified: Azure Data Engineer Associate; Oracle Database 12c Certified Implementation Specialist
• Required skills: Apache Airflow, Apache Kafka, Apache Spark, API Integration, AWS Data Pipeline, CI/CD, Databricks Platform, Data Engineering, Data ETL, Data Integration, Data Modeling, Data Quality, Git, Performance Tuning, Secure Coding Practices, Snowflake (Platform), Structured Query Language (SQL), System Performance Monitoring, Terraform (Software)
• English language proficiency: Proficient - C2

Details

• Location: 1401-G-India, GF/11, Pritech Park, Bangalore
• Remote type: Remote
• Work shift: Any (India)
• Job type: Regular