NVIDIA logo

Senior Software System Architect, AI Factory Management

NVIDIA
Posted this week

LOCATION

Netherlands · Remote

EXPERIENCE

8+ Years

TYPE

FullTime

SKILLS REQUIRED

System DesignDistributed SystemsObservabilityKubernetesMachine LearningGPU cluster managementAIOPS

Job description

Overview

Define architectures for networking management systems, AIOps platforms and applied AI solutions for AI cluster operations, translating operational challenges into scalable systems that are delivered into production.

What you'll do

  • Define architectures for management and intelligent automation capabilities spanning telemetry, observability, remediation, and operational automation.
  • Engage customers, cluster operations teams, and compute authorities to understand their challenges and architect solutions that improve operational efficiency, reliability, and scalability.
  • Partner with Product and Engineering to translate architectural recommendations into prioritized features and drive their inclusion in the Plan of Record (POR), defining requirements, dependencies, and success criteria.
  • Resolve system tradeoffs across hardware, firmware, software, and data platforms, with attention to scale, reliability, performance, and usability.
  • Guide design decisions through implementation, with hands-on development of targeted proofs of concept (PoCs) and technical investigations as needed to validate critical assumptions.
  • Offer strategic direction and system-level leadership throughout teams, guiding engineering choices and promoting sophisticated, AI-centered operating practices.

What you'll need

  • MSc. or higher in Computer Engineering or Computer Science (or equivalent experience).
  • 8+ years in system or software architecture, with a record of delivering sophisticated distributed systems in production.
  • Hands-on experience architecting and delivering distributed software systems, including cloud-native services, deployment, and orchestration.
  • Deep understanding of data center infrastructure across compute, networking, and management systems, including how these components interact at scale.
  • Ability to connect the big picture with precise technical reasoning and recognize which details matter.
  • Experience translating customer needs into system capabilities and influencing decisions across technical and product teams.
  • Strong ownership, initiative, and follow-through, supported by clear technical writing and communication.

Nice to have

  • Experience with AI factory infrastructure, large-scale GPU clusters, HPC, or distributed AI training and inference workloads.
  • Hardware/software co-design experience spanning compute, networking, firmware, and software.
  • Deep understanding of telemetry and observability platforms, including applying AI/ML.
  • Hands-on development of LLM agents, including orchestration, tool integration, context management, and evaluation.
  • Contributions to open-source communities, particularly in AI infrastructure or observability.

Details

  • Location: Netherlands, Remote.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Senior Software System Architect, AI Factory Management