Software Development Engineer II - Data Engineering

Overview

Software Development Engineer II focused on Data Engineering. Build and maintain scalable, real-time data pipelines and data infrastructure for ingestion, processing, governance, and storage.

What you'll do

• Develop and implement features for data ingestion, processing, governance, observability, and storage systems.
• Build components for scalable, accurate, real-time event collection systems.
• Implement data pipelines supporting AI model training and autonomous AI agents.
• Write clean, maintainable, and well-tested code following engineering standards.
• Contribute to improving existing systems and services using modern tooling.
• Identify and implement optimizations for ingestion, storage, and processing components.

What you'll need

• 2-4 years of software engineering experience with at least 2 years in data engineering or related fields.
• Hands-on experience with data processing frameworks such as Apache Spark or Apache Flink for batch and streaming.
• Working knowledge of at least one major cloud platform (AWS, GCP, or Azure) and data services.
• Solid SQL skills and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Cassandra, DynamoDB).
• Experience building ETL/ELT pipelines using tools like Apache Airflow or Prefect.
• Experience with monitoring and observability tools such as Datadog, Grafana, or Prometheus.
• Proficiency in at least one major programming language such as Python, Java, Scala, or Go.

Nice to have

• Some exposure to building data pipelines for machine learning workflows, feature engineering, or model training.

Details

• Location: Bengaluru.