Staff Engineer (Cloudera CDP & Hadoop Administration)

Overview

Staff Engineer to administer and support Cloudera CDP and Hadoop environments in Tier-2 production. The role focuses on installation, upgrades, security, troubleshooting (Spark/Hive/YARN), automation, CI/CD, GitOps, containers, observability, and patching.

What you'll do

• Administer, install, configure, maintain, and support Cloudera CDP and Hadoop in Tier-2 production environments.
• Perform installs, configuration, upgrades, patching, and maintenance for Cloudera CDP versions including CDP 7.1.9 or later.
• Configure and implement security requirements across Cloudera CDP, including automated security and regulatory compliance checks.
• Troubleshoot and resolve production issues related to Spark, Hive, and YARN jobs.
• Monitor and optimize cluster health, resource utilization, capacity, and overall CDP performance.
• Implement automation for cluster administration, operational processes, security checks, patching, and data/analytics workloads.

What you'll need

• 5.5+ years of hands-on Tier-2 production experience in Cloudera CDP and Hadoop administration.
• Experience installing, configuring, maintaining, and troubleshooting Cloudera CDP environments.
• Experience with Cloudera CDP 7.1.9 or later and Cloudera Data Services (1.5.4 and 1.5.5).
• Strong understanding of Hadoop ecosystem components, particularly Spark, Hive, and YARN.
• Hands-on automation experience using Ansible, Shell scripting, Terraform, Groovy, and Python.
• CI/CD pipeline experience using GitHub Actions, Jenkins, ArgoCD, or equivalent tools.
• Strong Linux administration and basic networking knowledge.

Details

• Location: Bengaluru, India.