Distinguished Architect, AI

Overview

Distinguished Architect, AI for Datadog’s Product Solutions Architecture team, focused on architecture leadership and customer advisory for AI/LLM observability and at-scale model workloads.

What you'll do

• Demonstrate thought leadership in the AI/LLM space.
• Lead high-level technical and architectural conversations around AI adoption.
• Run deep-dive architecture reviews and design engagements with customer teams.
• Identify emerging AI-native technology shifts and share them with Datadog Product Management.
• Co-create custom observability integrations and solutions with Product SAs.
• Collaborate with PSA, Sales, Sales Engineering, and Marketing to provide technical resources.
• Assist leadership with recruiting and hiring for PSA and Field CTO teams.

What you'll need

• 10+ years of experience in at-scale distributed systems architecture, high-performance computing, or large-scale infrastructure.
• Deep familiarity with the AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks.
• Experience influencing stakeholders including research scientists and technical founders.
• Close-to-the-metal, hands-on architectural credibility and ability to white-board solutions with senior engineers.
• Strong understanding of AI/LLM Ops and LLM Observability (LLMO).
• Excellent customer-facing presentation skills for large audiences and executives.
• Bachelor’s degree in engineering or related field; Master’s degree preferred.

Details

• Hybrid workplace.
• Travel up to 50% of the time.