Overview
Software Engineering Lead Analyst on Evernorth's Data and Analytics team, owning administration and observability of a production self-hosted Elastic Stack and delivering innovative solutions in an agile environment.
What you'll do
- Administer and support a production self-hosted Elastic Stack environment, including Elasticsearch, Kibana, Logstash, Elastic Agents, and supporting platform components.
- Perform cluster health monitoring, troubleshooting, capacity planning, and performance optimization.
- Configure and maintain Index Lifecycle Management (ILM), retention policies, shard allocation strategies, and storage management.
- Execute platform upgrades, patching activities, and lifecycle management.
- Implement and maintain backup, recovery, and disaster recovery procedures.
- Design and implement telemetry collection solutions for applications, databases, and infrastructure platforms.
- Integrate operational data from Apache Airflow, PostgreSQL, Linux servers, APIs and services, on-premises infrastructure, and future hybrid cloud platforms.
- Develop and maintain custom ingestion pipelines using Logstash, Elastic Agents, Beats, and OpenTelemetry collectors.
- Ensure reliable collection and delivery of logs, metrics, and traces.
- Create operational dashboards, alerts, and monitoring solutions within Kibana.
- Develop automated alerting capabilities for application, infrastructure, and platform health monitoring.
- Configure anomaly detection jobs and rule-based alerting to proactively identify issues.
- Collaborate with application teams to define meaningful operational metrics and alert thresholds.
- Continually improve observability coverage across supported platforms.
- Configure and maintain Elastic APM instrumentation across supported applications.
- Monitor application performance, latency, throughput, and error rates.
- Analyze distributed traces to identify bottlenecks and performance concerns.
- Develop Kibana dashboards that provide actionable performance insights for engineering teams.
- Support adoption of OpenTelemetry standards and best practices.
- Optimize Elasticsearch cluster performance and resource utilization.
- Monitor index growth, storage consumption, and ingestion rates.
- Support infrastructure hosting Elastic clusters, including servers, storage, and platform resources.
- Evaluate opportunities to improve operational efficiency and reduce platform costs.
- Assist with future migrations and integrations supporting hybrid deployment models.
What you'll need
- 5-8 years of experience in Platform Engineering, Observability Engineering, Infrastructure Engineering, Site Reliability Engineering, or related fields.
- 4+ years of hands-on experience administering production Elastic Stack environments.
- Experience supporting self-hosted Elasticsearch clusters.
- Experience managing Elasticsearch, Kibana, Logstash, Elastic Agents, and Beats.
- Experience building custom log and telemetry ingestion pipelines.
- Experience implementing monitoring, alerting, and anomaly detection solutions.
- Experience with Linux administration.
- Experience working with REST APIs and telemetry integrations.
- Experience with Python, Bash, or similar scripting languages.
- Required skills: Python, Elasticsearch, Kibana, Elastic Agents and APM, OpenTelemetry, Distributed Tracing, Metrics Collection, Log Analytics, Alerting and Monitoring.
Nice to have
- Experience implementing Elastic APM solutions.
- Experience with OpenTelemetry.
- Experience collecting observability data from Airflow, PostgreSQL, and distributed applications.
- Experience supporting hybrid cloud environments.
- Familiarity with AWS services and cloud observability practices.
- Experience with Docker or Kubernetes environments.
- Knowledge of infrastructure monitoring and capacity planning.
- Elastic Certified Observability Engineer certification is a plus.
Details
- Location: Hyderabad, India.
Read the full description and apply on the company’s own careers page.