Senior Data Engineer – Data & AI Platforms

Overview

Build and scale enterprise data platforms and reusable data products supporting analytics, artificial intelligence, machine learning, and business insights.

What you'll do

• Design and optimize scalable data pipelines using AWS, Snowflake, Python, and Apache Spark.
• Develop batch, event-driven, and distributed data processing solutions.
• Implement data quality, monitoring, error handling, metadata, and lineage capabilities.
• Enable governance through cataloging, access controls, auditability, and compliance.
• Support AI and machine learning initiatives through feature engineering and pipeline development.
• Apply version control, continuous integration, automated testing, and code reviews.
• Mentor engineers and collaborate with product, architecture, business, and platform teams.

What you'll need

• 7+ years of experience building modern data solutions.
• Expertise in Snowflake, SQL, Python, Apache Spark, and cloud technologies.
• Experience with ETL/ELT, data modelling, orchestration, and performance optimization.
• Hands-on experience with AWS Glue, S3, Lambda, Step Functions, and workflow orchestration tools.
• Experience implementing data governance, metadata, lineage, compliance, and security controls.
• Familiarity with AI, machine learning, Generative AI, MLOps, and automation concepts.
• Experience with CI/CD, automated testing, version control, and cloud-native engineering.

Nice to have

• Experience with Generative AI, Retrieval-Augmented Generation, or AI-driven automation solutions.
• Experience mentoring engineers and driving engineering best practices across teams.

Details

• Location: Hyderabad, India.
• Relocation support is available.
• Four openings are available.