Lead Compute Platform Engineer

Overview

Lead Compute Platform Engineer role on the Data Platform team, focused on building and running data infrastructure for the company’s platform, including a lakehouse platform.

What you'll do

• Operate and implement new features in the framework and services managed by the team.
• Collaborate with data scientists to improve their experience and productivity.
• Identify and implement computational improvements.
• Submit patches to open-source projects such as Spark, Iceberg, Hadoop, and Airflow.
• Serve as an expert on Spark and Scala.
• Mentor engineers through pairing, design discussions, and knowledge-sharing.

What you'll need

• Minimum 7 years of software engineering experience.
• Degree in Computer Science, Software Engineering, Physics, Math, or a related field.
• 2+ years of experience and proficiency in Scala or other JVM-based languages.
• Experience with Spark and/or other large-scale data-processing frameworks.
• Basic knowledge of Amazon Web Services (EC2, S3, Athena, etc.).
• Interest in back-end technologies, architecture, and learning new technologies.
• Analytical and pragmatic approach to problem-solving with ability to work independently.

Details

• Location: Berlin, Germany.