Research Engineer/Research Scientist, Pre-training

Overview

Research Engineer for the Pre-training team, responsible for developing the next generation of large language models.

What you'll do

• Conduct research and implement solutions across model architecture, algorithms, data processing, and optimizer development.
• Independently lead small research projects while collaborating on larger initiatives.
• Design, run, and analyze scientific experiments to advance understanding of large language models.
• Optimize and scale training infrastructure to improve efficiency and reliability.
• Develop and improve developer tooling to enhance team productivity.
• Contribute across the stack from low-level optimizations to high-level model design.

What you'll need

• Have an MS or PhD in Computer Science, Machine Learning, or a related field.
• Demonstrate strong software engineering skills building complex systems.
• Use Python and have experience with deep learning frameworks, with PyTorch preferred.
• Be familiar with large-scale machine learning in the context of language models.
• Balance research goals with practical engineering constraints.
• Show strong problem-solving skills and a results-oriented mindset.
• Have strong communication skills and work collaboratively.

Details

• Hybrid work: expected in an office at least 25% of the time.