Software Development Engineer II – Data Engineer

Overview

Build Gather AI's data foundation from scratch as an SDE II, Data Engineer. Start with pipelines and models for the Drone product, then grow toward end-to-end ownership of a data domain.

What you'll do

• Build incremental extraction pipelines from production PostgreSQL to an analytical warehouse.
• Write and maintain shared dbt models, dimensions, metrics, and serving tables.
• Add semantic-layer metrics with consistent definitions across dashboards.
• Implement tests, freshness checks, alerts, and safe backfills.
• Apply tenant-isolation and access-control patterns to models and pipelines.
• Maintain lineage from metrics to source records, images, and videos.
• Join on-call and help onboard additional products to the data foundation.

What you'll need

• 2–5 years building and running production data pipelines.
• Strong SQL, including joins, window functions, CTEs, and dimensional modelling.
• Experience building tested transformation models with dbt or an equivalent tool.
• Production Python pipeline development with tests and code review.
• Experience with orchestration, failures, re-runs, and backfills.
• Experience moving operational data into a warehouse or lakehouse.
• Production cloud experience, including object storage, Git, CI/CD, and Docker/Kubernetes.

Nice to have

• Experience with CDC, streaming, PySpark, Snowpark, or Terraform.
• Experience with semantic layers, data catalogs, multi-tenant platforms, or row-level security.
• Experience with image, video, sensor, logistics, warehousing, or robotics data.

Details

• Fully remote role on an India-based team.
• Collaborates across multiple time zones.