Lead Data Engineer - Data Engineering 4C

Overview

Lead a team of data engineers building Big Data solutions, with a focus on scalable pipelines, ETL processes, and data quality across data systems.

What you'll do

• Lead a team of data engineers in developing and implementing Big Data solutions.
• Design and build scalable and reliable data pipelines and ETL processes.
• Ensure data quality, integrity, and security across all data systems.
• Collaborate with stakeholders to understand and address business requirements.
• Provide technical guidance and mentorship to junior team members.
• Stay current with industry trends and technologies related to Big Data and data engineering.
• Perform data analysis and troubleshooting to optimize system performance and efficiency.
• Develop and maintain documentation for data processes, systems, and infrastructure.

What you'll need

• Bachelor's degree in Computer Science, Data Science, or Statistics, or Master's degree in Data Science.
• Certifications: Certified Data Management Professional (Riversand); Databricks Certified Associate Developer for Apache Spark 3.0 or Apache Spark (Databricks Academy); Microsoft Certified: Azure Data Engineer Associate; Oracle Database 12c Certified Implementation Specialist.
• Required skills: Apache Airflow, Apache Kafka, Apache Spark, API Integration, AWS Data Pipeline, CI/CD, Databricks Platform, Data Engineering, Data ETL, Data Integration, Data Modeling, Data Quality, Git, Performance Tuning, Secure Coding Practices, Snowflake (Platform), Structured Query Language (SQL), System Performance Monitoring, Terraform (Software).
• Language: English, proficient (C2 overall).

Details

• Location: Hyderabad, India (Floor 1 to 12, Hafeezpet Phoenix).
• Work mode: Hybrid.
• Work shift: Flex Time (India).
• Job type: Regular.