Data Engineer II

Overview

Data Engineer II to build and maintain data pipelines for HackerRank’s data platform and AI-related data products.

What you'll do

• Build and maintain pipelines on StarRocks, Apache Hudi, Trino, and Spark.
• Support in-product data features including exports, dashboards, interview analytics, and custom reports.
• Create clean, structured datasets to support AI-powered natural language querying.
• Implement access controls and data security policies using tools such as Apache Ranger.
• Contribute to self-service pipelines to reduce ad-hoc internal data requests.
• Troubleshoot data quality and pipeline issues and document work.

What you'll need

• 2-4 years of data engineering experience.
• Working knowledge of at least one OLAP database (e.g., StarRocks, ClickHouse, or Druid).
• Some experience with data lake technologies (e.g., Hudi, Iceberg, or Delta Lake).
• Familiarity with distributed query engines (Trino/Presto) and Spark, or strong SQL/Python fundamentals.
• Basic understanding of data security and access control concepts.
• Comfort with an AWS + open-source environment.

Details

• Work mode: Hybrid in Bangalore, India.