Lead Data Engineer - Data Engineering 4C

Overview

Lead a team of data engineers in building and deploying Big Data solutions, with scalable data pipelines and ETL processes as a core part of the work.

What you'll do

• Lead a team of data engineers in developing and implementing Big Data solutions.
• Design and build scalable and reliable data pipelines and ETL processes.
• Ensure data quality, integrity, and security across all data systems.
• Collaborate with stakeholders to understand and address business requirements.
• Provide technical guidance and mentorship to junior team members.
• Stay current with industry trends and technologies related to Big Data and data engineering.
• Perform data analysis and troubleshooting to optimize system performance and efficiency.
• Develop and maintain documentation for data processes, systems, and infrastructure.

What you'll need

• Bachelors in Computer Science, Data Science, or Statistics, or Masters in Data Science.
• Required skills: Apache Airflow, Apache Kafka, Apache Spark, API Integration, AWS Data Pipeline, CI/CD, Databricks Platform, Data Engineering, Data ETL, Data Integration, Data Modeling, Data Quality, Git, Performance Tuning, Secure Coding Practices, Snowflake (Platform), Structured Query Language (SQL), System Performance Monitoring, Terraform (Software).
• Language: English, proficient (C2).

Nice to have

• Certified Data Management Professional - Riversand.
• Databricks Certified Associate Developer for Apache Spark 3.0 or Databricks Certified Associate Developer for Apache Spark (Databricks Academy).
• Microsoft Certified: Azure Data Engineer Associate.
• Oracle Database 12c Certified Implementation Specialist.

Details

• Location: 1401-G-India, Imagine Tech Park, Plot no 6, Kolkata.
• Work mode: Hybrid.
• Work shift: Flex Time (India).
• Job type: Regular.