Lead Systems Engineer - Infra Reliability Engineer

Overview

Lead Systems Engineer (Infrastructure Reliability Engineer) on Fidelity's Enterprise Infrastructure & Operations Distributed Compute and Storage team, using automation, Infrastructure as Code, observability and operational data to improve the availability and resiliency of enterprise infrastructure services.

What you'll do

• Engineer and operate resilient enterprise infrastructure services across on-premises and cloud environments.
• Develop automation that improves infrastructure reliability, scalability, supportability and operational efficiency.
• Automate common operational activities and eliminate repetitive manual processes.
• Build observability capabilities that provide meaningful insight into infrastructure health and service reliability.
• Partner with Compute, Storage, Cloud, Network, Security and Application Engineering teams to resolve complex infrastructure problems.
• Participate in major incident response and provide engineering expertise during infrastructure service disruptions.
• Conduct post-incident analysis and convert lessons learned into automation, monitoring, resiliency or platform improvements.
• Improve infrastructure patching, maintenance, provisioning, lifecycle management and recovery through automation.
• Participate in capacity planning and proactively identify scalability or performance constraints.
• Engineer and test backup, recovery and disaster recovery capabilities.
• Develop reusable automation and self-service capabilities for infrastructure consumers.
• Contribute to technical standards, engineering best practices, documentation and operational procedures.
• Challenge existing operational processes and identify opportunities to simplify, standardize, automate and engineer away operational toil.
• Apply reliability engineering principles to improve availability, resiliency, performance, recoverability and operational readiness of infrastructure platforms.
• Identify reliability risks and engineer solutions that eliminate or reduce recurring infrastructure failures.
• Establish meaningful health indicators, operational metrics, dashboards, alerts and reliability measures for infrastructure services.
• Use operational data and production insights to identify patterns and proactively address potential reliability issues.
• Participate in reliability reviews, failure analysis and continuous improvement initiatives.
• Promote blameless root cause analysis and translate incident learnings into engineering improvements.
• Develop reusable automation utilizing technologies such as Python, PowerShell, Shell, Golang, Ansible, Terraform, APIs and CI/CD pipelines.
• Automate infrastructure provisioning, configuration, validation, maintenance, recovery and operational workflows.
• Integrate infrastructure platforms through REST APIs and automation frameworks.
• Apply software engineering disciplines including source control, code reviews, automated testing, reusable components and CI/CD to infrastructure automation.
• Identify opportunities to transition infrastructure activities from ticket-driven operations to automated and self-service capabilities.
• Build and maintain dashboards, monitoring, logging and alerting capabilities for infrastructure platforms.
• Develop actionable infrastructure health signals rather than relying solely on threshold-based monitoring.
• Correlate telemetry across infrastructure components to accelerate issue identification and resolution.
• Analyze operational and infrastructure data to identify recurring failures, performance bottlenecks, capacity risks, availability trends, automation opportunities and reliability improvement opportunities.
• Develop data-driven insights and visualizations using platforms such as Splunk, Datadog, Grafana, Power BI or Tableau.
• Engineer infrastructure platforms with recoverability as a core design principle.
• Support enterprise backup and recovery capabilities across compute, storage, virtualization, cloud and application infrastructure.
• Automate backup validation and recovery workflows to improve consistency and reduce recovery time.
• Participate in disaster recovery and resiliency exercises, including recovery into alternate or newly established infrastructure environments.
• Validate that infrastructure recovery processes meet defined recovery objectives.
• Identify opportunities to continuously improve Recovery Time Objective (RTO) and Recovery Point Objective (RPO) capabilities.
• Use automation and testing to demonstrate that recovery capabilities work when required rather than relying solely on documented procedures.

What you'll need

• Hands-on experience with several of: Linux/Unix; Windows Server; VMware/virtualization; enterprise compute; enterprise storage; Kubernetes/container platforms; backup and recovery technologies; AWS, Azure or private/hybrid cloud.
• Hands-on experience with several of: Python, PowerShell, Go Lang, Shell scripting, Ansible, Terraform, REST APIs.
• Hands-on experience with several of: Datadog, Splunk, Prometheus, Grafana, ELK/OpenSearch, OpenTelemetry.
• Hands-on experience with several of: Git, Jenkins, CI/CD, Agile engineering practices, automated testing.
• Systems-thinking and engineering mindset when approaching complex infrastructure and reliability challenges.
• Curiosity and discipline in understanding root causes, with a focus on preventing recurrence rather than only restoring service.
• Automation-first mindset, continuously identifying opportunities to eliminate repetitive operational work and reduce manual effort.
• Strong problem-solving capabilities across complex, interconnected infrastructure technologies and services.
• Data-driven decision making, using telemetry, operational insights and trends to identify and prioritize reliability improvements.
• Strong understanding of reliability principles, including availability, resiliency, recoverability, observability, scalability and operational simplicity.
• Effective collaboration across infrastructure, engineering, operations, application, cloud and technology teams.
• Clear communication skills, with the ability to articulate complex technical topics to both technical and non-technical stakeholders.
• Ownership and accountability, with a strong focus on delivering outcomes and driving continuous improvement.
• Commitment to engineering excellence, with an emphasis on automation, standardization, simplification and sustainable operational practices.
• Soft skills: organizational agility, communications, influencing, time management, contextual awareness and ability to work under pressure.

Details

• Location: Bangalore, India.
• Shift timings: rotational across two 9-hour shifts, 6:00 AM to 3:00 PM IST and 2:00 PM to 11:00 PM IST, five days a week, including weekend days and holidays as rostered.