Data Engineer – DEPS, MTCR

Overview

Data Engineer (DEPS) to manage Cloudera CDP/CDH environments and build/operate data engineering and DevOps automation pipelines.

What you'll do

• Administer and support Cloudera CDP/CDH platforms including HDFS, Hive, Spark, YARN, Hue, and CDE.
• Develop, deploy, and optimize PySpark and Python-based data processing solutions.
• Build and maintain CI/CD pipelines using Jenkins and GitHub/Bitbucket.
• Integrate security and code quality tools such as Checkmarx into delivery pipelines.
• Write and optimize SQL queries for Hive and Impala environments.
• Monitor platform health, perform upgrades, troubleshoot issues, and ensure high availability.
• Implement security controls, access management, and governance best practices.

What you'll need

• Experience: 3–5 years.
• Hands-on experience with Cloudera Hadoop/CDP platforms.
• Expertise in HDFS, Spark/PySpark, Python, Hive, YARN, Hue, and CDE.
• Hands-on experience with Jenkins, GitHub/Bitbucket, and CI/CD practices.
• Good knowledge of SQL and performance tuning.
• Experience with Checkmarx or similar SAST tools.
• Strong Linux administration and scripting skills.

Details

• Location: Bangalore and Pune (Hybrid – Client Office).