Principal Solutions Architect - Observability and AI

Overview

Design and scale next-generation observability and reliability frameworks, champion modern telemetry practices, build predictive monitoring systems, and ensure infrastructure meets high availability standards.

What you'll do

• Design end-to-end telemetry systems focusing on metrics, logs, and traces.
• Build anomaly detection engines using system KPIs to catch issues before impacts occur.
• Deploy machine learning or statistical models to forecast capacity and system degradation.
• Create intuitive, multi-tier visualization dashboards offering both high-level system health and granular component views.
• Establish architectural patterns aligned with "Five Nines" (99.999%) availability principles.
• Establish SLA, SLO, and SLI frameworks across distributed engineering teams.

What you'll need

• Bachelor's degree in computer science or Electronics Engineering.
• Deep expertise in Datadog, OpenTelemetry, or Prometheus/Grafana.
• Strong hands-on experience with statistical analysis, time-series data, and predictive alerting.
• Advanced knowledge of AWS, Azure, or GCP infrastructure and microservices scaling.
• Proven track record of designing fault-tolerant, self-healing distributed systems.
• Design algorithms to spot baseline deviations instead of relying on static, manual alert thresholds.
• Build systems that automatically link spikes in metrics to errors in logs and traces.
• Use time-series forecasting to predict infrastructure bottlenecks and auto-scale resources before failures occur.
• Implement ML-driven event deduplication and grouping to eliminate alert fatigue.
• Proven ability to mentor engineering teams and communicate complex technical concepts to Leadership team.

Details

• Position type: Experienced.
• Travel requirements: None.
• Relocation: Not provided.