T

Technical Support Engineer (Inference)

Together AI
NewPosted today

LOCATION

Pune or Bangalore · Onsite

EXPERIENCE

6+ Years

TYPE

FullTime

SKILLS REQUIRED

Technical SupportKubernetesSite Reliability EngineeringGPU cluster managementObservability

Job description

Overview

As a Technical Support Engineer (Inference), you will be the first line of technical defense for customers building training, fine-tuning and inference solutions with Together AI, acting as a customer-facing SRE and product expert.

What you'll do

  • Engage directly with customers to resolve complex technical challenges involving GPU clusters and inference and fine-tuning services, ensuring swift and effective solutions.
  • Act as a customer-facing SRE to keep customers' inference endpoints (running on Kubernetes) healthy, stable and performant.
  • Become a product expert in all Gen AI solutions, serving as the last line of technical defense before escalation to Engineering and Product teams.
  • Assist with hardware and platform migrations by validating system health and traffic routing.
  • Monitor dashboards to detect anomalies and escalate with data-backed analysis.
  • Manage customer-facing communications during incidents and degradations, translating technical findings into clear, evidence-backed updates without exposing platform internals.
  • Contribute infrastructure changes for model deployment, capacity rebalancing and cluster configuration via pull requests (infra-as-code), such as endpoint configuration, model bringup/bringdown and capacity scaling.
  • Flag engine-level bugs with logs and reproduction steps for engineering.
  • Collaborate across Engineering, Research and Product teams to address customer concerns, including with senior leaders internally and externally.
  • Identify patterns in support cases and work with Engineering and Go-To-Market teams to drive Together's roadmap (e.g., future models to support).
  • Maintain detailed documentation of system configurations, procedures, troubleshooting guides and FAQs for team and customer knowledge sharing.
  • Provide support coverage during holidays, nights and weekends as required by business needs.

What you'll need

  • 6+ years of experience in a customer-facing technical role, SRE, DevOps or infrastructure engineering, with at least 1 year in a support role for an AI service.
  • Strong technical background with knowledge of AI, ML, GPU technologies and their integration into high-performance computing (HPC) environments.
  • Advanced, production-level experience with infrastructure services (e.g., Kubernetes, SLURM), infrastructure as code (e.g., Ansible), high-performance network fabrics, NFS-based storage management and container infrastructure.
  • Familiarity with operating storage systems in HPC environments such as Vast and Weka.
  • Proven ability to diagnose complex network-layer issues and read traces.
  • Strong knowledge of Python, TypeScript and/or JavaScript, with testing/debugging experience using curl and Postman-like tools.
  • Demonstrated expertise with observability tooling (e.g., Prometheus, Grafana) at scale.
  • Deep familiarity with REST API debugging and HTTP semantics.
  • Experience with LLM inference frameworks, LoRA fine-tuning and common training failure modes.
  • Experience with Infrastructure as Code and Git-based workflows.
  • Background in GPU cluster management.
  • Cloud platform experience (AWS, GCP and/or Azure).
  • Foundational understanding of installation, configuration, administration, troubleshooting and securing of compute clusters.
  • Complex technical problem solving and troubleshooting, with a proactive approach to issue resolution.
  • Ability to work cross-functionally with Sales, Engineering, Support, Product and Research teams to drive customer success.
  • Strong sense of ownership and willingness to learn new skills.
  • Excellent communication and interpersonal skills, with the ability to explain complex technical concepts to non-technical stakeholders.
  • Ability to operate in dynamic environments, manage multiple projects and handle frequent context switching and prioritization.

Details

  • Location: Pune or Bangalore, India.
  • Full-time position working India daytime hours, Monday to Friday.
  • Support coverage required during holidays, nights and weekends as business needs require.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Technical Support Engineer (Inference)