Overview
Senior Software Engineer on a team building a global context layer for data in Astronomer’s unified DataOps platform powered by Apache Airflow.
What you'll do
- Design and build the foundation and applications for Astronomer’s context layer.
- Engineer components for data modeling, semantic search, retrieval, and code generation.
- Experiment with LLMs, embeddings, and retrieval techniques to build developer tools.
- Collaborate with R&D and product teams to turn early AI concepts into product experiences.
- Solve information retrieval and search challenges at global scale.
- Influence technical vision and architecture for the next generation of AI-driven data products.
- Represent Astronomer through open-source contributions, technical talks, and publications.
What you'll need
- 5-8 years of software engineering experience with Python or Go.
- Empathy for users and a deep interest in improving workflows of data professionals.
- Familiarity with early-stage product development and comfort working with ambiguity.
- Experience with LLMs, vector databases, embeddings, or other applied AI areas, or a strong desire to dive in.
- Creative, experimental mindset with iterative validation of hypotheses.
- Strong collaboration and communication skills for technical and non-technical audiences.
Nice to have
- Passion for AI systems for data, developer tools, or machine learning infrastructure.
- Familiarity with Apache Airflow or other orchestration tools.
- Demonstrated contributions to open source projects.
- Experience in search, IR, or large-scale data infrastructure.
- Exposure to early-stage startups or R&D organizations.
- Experience building agentic systems on top of frontier models.
Details
- Hybrid work model with at least 3 days per week in the New York City office.
Read the full description and apply on the company’s own careers page.
