Overview
As a Technical Support Engineer (Inference), you will be the first line of technical defense for customers building training, fine-tuning and inference solutions with Together AI, acting as a customer-facing SRE and product expert.
What you'll do
- Engage directly with customers to resolve complex technical challenges involving GPU clusters and inference and fine-tuning services, ensuring swift and effective solutions.
- Act as a customer-facing SRE to keep customers' inference endpoints (running on Kubernetes) healthy, stable and performant.
- Become a product expert in all Gen AI solutions, serving as the last line of technical defense before escalation to Engineering and Product teams.
- Assist with hardware and platform migrations by validating system health and traffic routing.
- Monitor dashboards to detect anomalies and escalate with data-backed analysis.
- Manage customer-facing communications during incidents and degradations, translating technical findings into clear, evidence-backed updates without exposing platform internals.
- Contribute infrastructure changes for model deployment, capacity rebalancing and cluster configuration via pull requests (infra-as-code), such as endpoint configuration, model bringup/bringdown and capacity scaling.
- Flag engine-level bugs with logs and reproduction steps for engineering.
- Collaborate across Engineering, Research and Product teams to address customer concerns, including with senior leaders internally and externally.
- Identify patterns in support cases and work with Engineering and Go-To-Market teams to drive Together's roadmap (e.g., future models to support).
- Maintain detailed documentation of system configurations, procedures, troubleshooting guides and FAQs for team and customer knowledge sharing.
- Provide support coverage during holidays, nights and weekends as required by business needs.
What you'll need
- 6+ years of experience in a customer-facing technical role, SRE, DevOps or infrastructure engineering, with at least 1 year in a support role for an AI service.
- Strong technical background with knowledge of AI, ML, GPU technologies and their integration into high-performance computing (HPC) environments.
- Advanced, production-level experience with infrastructure services (e.g., Kubernetes, SLURM), infrastructure as code (e.g., Ansible), high-performance network fabrics, NFS-based storage management and container infrastructure.
- Familiarity with operating storage systems in HPC environments such as Vast and Weka.
- Proven ability to diagnose complex network-layer issues and read traces.
- Strong knowledge of Python, TypeScript and/or JavaScript, with testing/debugging experience using curl and Postman-like tools.
- Demonstrated expertise with observability tooling (e.g., Prometheus, Grafana) at scale.
- Deep familiarity with REST API debugging and HTTP semantics.
- Experience with LLM inference frameworks, LoRA fine-tuning and common training failure modes.
- Experience with Infrastructure as Code and Git-based workflows.
- Background in GPU cluster management.
- Cloud platform experience (AWS, GCP and/or Azure).
- Foundational understanding of installation, configuration, administration, troubleshooting and securing of compute clusters.
- Complex technical problem solving and troubleshooting, with a proactive approach to issue resolution.
- Ability to work cross-functionally with Sales, Engineering, Support, Product and Research teams to drive customer success.
- Strong sense of ownership and willingness to learn new skills.
- Excellent communication and interpersonal skills, with the ability to explain complex technical concepts to non-technical stakeholders.
- Ability to operate in dynamic environments, manage multiple projects and handle frequent context switching and prioritization.
Details
- Location: Pune or Bangalore, India.
- Full-time position working India daytime hours, Monday to Friday.
- Support coverage required during holidays, nights and weekends as business needs require.
Read the full description and apply on the company’s own careers page.