Data Engineer

Overview

Engineer II AWS Data Engineer in the Data Ingest Batch Integration organization, building scalable, secure, high-performance AWS data platforms for batch and event ingestion.

What you'll do

• Design, develop, and maintain distributed AWS data pipelines to ingest, process, and deliver data at scale.
• Implement batch and event-driven processing patterns using AWS-native services.
• Build event-driven, asynchronous architectures for near real-time processing and scalability.
• Use Python with AWS Glue and pyspark to process large datasets.
• Ensure data quality with validation/monitoring, establish data lineage, and manage orchestration workflows.
• Develop RESTful and event-driven APIs and deploy data services on Docker and Kubernetes.

What you'll need

• 5+ years of experience in data engineering or distributed systems development.
• Strong hands-on AWS cloud services experience.
• Advanced proficiency in Python.
• Hands-on experience with Apache Spark and AWS.
• A B.E in Computer Science, Engineering, or equivalent practical experience.
• Core experience developing event-driven data pipelines.
• Hands-on experience with Docker and Kubernetes.

Details

• Location: Hyderabad.