Sr Engineer

Overview

Senior Data Engineer (Sr Engineer) to build and operate scalable, secure, high-performance data platforms on AWS for analytics, reporting, and downstream applications.

What you'll do

• Design, develop, and maintain distributed AWS data pipelines for large-scale data ingestion and delivery.
• Implement batch and event-driven data processing using AWS-native services.
• Build event-driven, asynchronous, decoupled architectures for near real-time processing.
• Use Python and Apache Spark to process large datasets with performance and fault-tolerance best practices.
• Ensure data quality, lineage, and governance with validation, monitoring, and orchestration workflows.
• Develop RESTful and event-driven APIs to expose data and data services.
• Build and deploy containerized data services using Docker and operate workloads on Kubernetes.

What you'll need

• 8+ years of experience in data engineering or distributed systems development.
• Hands-on AWS cloud services experience.
• Advanced proficiency in Python.
• Hands-on experience with Apache Spark.
• Experience building event-driven data pipelines.
• Strong knowledge of data quality, data lineage, and orchestration.
• Hands-on experience with Docker and Kubernetes.

Details

• Location: Hyderabad.