Data Engineer

Overview

Data Engineer responsible for building and operating data capabilities, pipelines, and solutions across the data lifecycle.

What you'll do

• Develop and maintain ETL/ELT pipelines from varied data sources into data warehouses.
• Design real-time data ingestion pipelines and scalable data architectures.
• Optimize data storage and retrieval for performance and scalability.
• Collaborate with architects, analysts, scientists, and data teams on infrastructure needs.
• Implement data validation, testing, and security protocols.
• Automate processes and improve data delivery and infrastructure scalability.
• Lead complex solution analysis, recommendations, and execution.

What you'll need

• 3–5 years of hands-on experience implementing and operating data capabilities and solutions.
• 5+ years of experience in data engineering or software development.
• Expertise with Databricks, AWS data engineering, CloudFormation, and GitHub Workflows.
• Experience with AWS services including Lambda, S3, Glue, Crawlers, and APIs.
• Strong programming skills in Python, R, PyTorch, PySpark, Pandas, or Scala.
• Experience with SQL and databases such as MySQL, PostgreSQL, or Presto.
• Strong analytical, problem-solving, communication, and collaboration skills.

Nice to have

• Experience with AWS Data Zone, Redshift, Athena, Lake Formation, Cloudera Data Platform, or Tableau.
• Functional knowledge of the life sciences research and development domain.

Details

• Location: Hyderabad, Telangana, India.