Software Engineer, Ray Data

Overview

Software Engineer for Anyscale’s Ray Data team, working on Ray Datasets and data processing capabilities within the Ray ecosystem.

What you'll do

• Develop open source software to simplify distributed programming with Ray.
• Identify, implement, and evaluate architectural improvements to Ray Core and Ray Datasets.
• Improve Ray’s testing process to make releases smoother.
• Build and optimize Ray Datasets performance at large scale.
• Support integration with ML training and data sources.
• Work on stability and stress testing infrastructure.
• Communicate work via talks, tutorials, and blog posts.

What you'll need

• At least 5 years of relevant work experience.
• Solid background in algorithms and data structures.
• Solid background in system design.
• Experience building scalable and fault-tolerant distributed systems.
• Experience with data processing and database internals including Spark or Dask.

Nice to have

• Streaming experience is a plus.

Details

• Location: Bengaluru, Karnataka.