Data Engineer III (Remote, IND)

Overview

Data Engineer supporting pipelines, infrastructure, automation, and services for machine learning products and large-scale data analysis.

What you'll do

• Design and build services that power machine learning products.
• Build automation tools for scientists to deploy models.
• Maintain and improve production data systems.
• Participate in code reviews and pull requests.
• Collaborate across teams contributing to machine learning data.

What you'll need

• 7+ years of relevant work experience.
• BS degree in Computer Science or a related field.
• Knowledge of AWS, Python, Golang, Kafka, Airflow, Docker, Linux, or Kubernetes.
• Experience working with large volumes of data.
• Knowledge of distributed system design and tradeoffs.
• Knowledge of CI/CD best practices.
• Experience using AI technologies to improve workflows, efficiency, and business outcomes.

Nice to have

• Experience creating automated or scalable infrastructure and pipelines.
• Open-source contributions.
• Experience with Spinnaker, relational databases, or key-value stores.
• Experience with Spark or other Big Data technologies.
• Experience with AWS Batch, EMR, Glue, or SageMaker.
• Cybersecurity or intelligence experience.

Details

• Remote position for candidates located in India.