Data Engineer

Overview

Run live client projects on the Karya platform, covering project workflows, data jobs, checks, reports, and delivery. Work with Operations, client teams, and platform engineers on progress, quality, pay, files, and product fixes.

What you'll do

• Run and monitor data jobs on remote Linux servers, and recover failed jobs from logs and process state.
• Configure project workflows, including the handoff from automated processing to human tasks, and track what is in progress, held, or ready to deliver.
• Write PostgreSQL and ClickHouse queries for throughput, completion, quality, pay, and delivery status.
• Apply completion and quality rules to access, pay, and delivery decisions after a sample check.
• Write Python, SQL, or Bash scripts for checks and decisions, and keep them in the repository.
• Package datasets to client specifications, move them through cloud object storage, and record what has shipped.
• Read the TypeScript / Node.js codebase to follow tasks, assignments, payments, and file storage.
• Reply to Operations and client teams with the finding, the change made, and what is still open.
• Report repeated manual work to platform engineering, with an example.

What you'll need

• PostgreSQL, including joins, aggregates, and JSON fields.
• Scripts in Python, Bash, or TypeScript, checked into git.
• Ability to read a TypeScript codebase and a relational schema.
• Linux for running jobs: SSH, logs, long-running processes, and disk.
• Ability to write technical updates that give non-technical teammates a clear picture of the situation.
• Queries or scripts already run against real project or production data.

Nice to have

• Cloud object storage, including Google Cloud Storage, S3, or Azure Blob.
• Experience with collected datasets such as speech, text, or images.
• ClickHouse, Metabase, or a similar reporting tool.

Details

• Location: Bengaluru.
• The perks mention remote or hybrid work.