Specialist, Cloud Data Engineering

Overview

Software Engineer role in the Cloud Data Engineering team supporting Research Labs with large-scale scientific data processing, pipelines and data movement on AWS and HPC infrastructure, based in Hyderabad.

What you'll do

• Provide engineering support for day-to-day activities and needs in the infrastructure.
• Execute scientific pipelines and support data movement.
• Promote and help with the adoption of development, design, architecture and DevOps best practices, with a focus on agile delivery.
• Manage technical and business dependencies and bottlenecks; balance technical constraints with business requirements and deliver maximum business impact with solid customer experience.
• Collaborate with scientists, peers and business leaders in different geographical locations to define and deliver complex engineering features.
• Communicate effectively with technical and non-technical audiences.

What you'll need

• BS or MS in Computer Science/engineering or equivalent technical field.
• 3 to 6 years of experience in Cloud Data Engineering.
• Proficient (3+ years hands-on experience) with Python.
• Data manipulation using Linux command line tools and batch processing.
• Large data processing and data consistency validation.
• AWS CLI for data manipulation (AWS CLI, boto3).
• AWS filesystem experience (S3, EFS, EBS).
• Linux filesystems experience (NFS).

Nice to have

• Experience with bioinformatics pipelines and data formats (FastQ, BAM) (described as a huge advantage).
• Experience with IaC frameworks (CloudFormation, Ansible, Terraform).
• AWS compute services (EC2, Lambda).
• Data engineering and DevOps practices.
• Agile development and batch processing.

Details

• Location: Hyderabad (Hitec City Raidurg), India.
• Flexible work arrangement: Hybrid.
• Relocation: Domestic.
• Visa sponsorship: No.
• Travel: No travel required.
• Employee status: Regular.