Senior Engineer - Backend data

Overview

Senior Data Engineer role focused on designing, developing, and optimizing large-scale data platforms and pipelines for analytical and business use cases.

What you'll do

• Design, develop, and maintain scalable data pipelines and data processing frameworks using Spark, Scala, BigQuery, and other Big Data technologies.
• Build robust ETL/ELT pipelines for high-volume, complex datasets.
• Develop and optimize data models and BigQuery tables using partitioning, clustering, query design, and storage strategies.
• Design and implement scalable batch and distributed data processing solutions using Apache Spark.
• Implement data quality, validation, monitoring, and observability across data pipelines and datasets.
• Troubleshoot complex data, pipeline, infrastructure, and production issues to drive root-cause resolution.

What you'll need

• 5+ years of experience in software or data engineering building and supporting large-scale data platforms.
• Strong hands-on experience with Apache Spark, Scala, and Google BigQuery.
• Strong SQL skills working with large and complex datasets.
• Experience designing and optimizing data pipelines for high-volume, high-performance processing.
• Strong understanding of distributed computing concepts including partitioning, joins, aggregations, scalability, and performance optimization.
• Experience with cloud-based data platforms, preferably Google Cloud Platform (GCP).
• Good understanding of data modeling (including fact/dimension models and analytical data structures).

Nice to have

• Java and Spring Boot experience.
• Experience with REST APIs or microservices.
• Kafka or other event-streaming technologies.
• Experience with CI/CD tools such as Jenkins or GitHub Actions.
• Exposure to Generative AI and AI-assisted engineering tools (e.g., GitHub Copilot, Claude).
• Experience with containerization technologies such as Docker.

Details

• Location: Bangalore, India.