Sr. Software Development Engineer

Overview

Senior Software Engineer on the Beacon Risk & Pricing Platform team, designing and operating mission-critical market data and reference data pipelines that feed real-time pricing and risk engines.

What you'll do

• Design and build scalable Python-based ETL/ELT pipelines ingesting multi-asset market data (equities, fixed income, derivatives, FX, commodities) from vendors such as Bloomberg, Refinitiv/LSEG, ICE Data Services, and FactSet.
• Engineer and maintain a robust securities master (reference data) system covering identifiers (CUSIP, ISIN, SEDOL, FIGI), corporate actions, instrument attributes, and classification hierarchies.
• Build real-time and batch data feeds using AWS-native services (Kinesis, MSK/Kafka, Glue, Lambda, Step Functions) with SLAs measured in milliseconds to seconds.
• Implement data quality frameworks, including completeness checks, anomaly detection, stale-data alerting, and automated reconciliation against authoritative vendor sources.
• Architect cloud-native, event-driven data infrastructure on AWS (S3, Redshift, RDS Aurora, DynamoDB, ElastiCache) with Infrastructure-as-Code (Terraform / CDK).
• Contribute to CI/CD pipelines and ensure deployments are automated, tested, and observable (CloudWatch, Datadog, OpenTelemetry).
• Drive schema design, data modelling, and partitioning strategies that balance query performance against storage cost at petabyte scale.

What you'll need

• 7+ years of software engineering experience, with at least 4 years building production data pipelines in Python (Pandas, PySpark, asyncio, or equivalent).
• Deep hands-on experience with AWS data services: S3, Glue, Lambda, Kinesis / MSK, Redshift, RDS, Step Functions.
• Strong understanding of market data domains (pricing, corporate actions, identifier mapping, instrument reference data) from a financial services or fintech context.
• Experience designing and operating high-availability, low-latency streaming and batch pipelines in production.
• Proficiency in SQL and data modelling for analytical and operational workloads.
• Familiarity with data quality patterns: schema validation, reconciliation, SLA monitoring, dead-letter queues, and alerting.
• Strong communication skills: writes clear design docs, runs productive tech discussions, and collaborates across disciplines.

Nice to have

• Experience with securities master / reference data systems: CUSIP, ISIN, SEDOL, FIGI, and corporate action processing.
• Prior integration with major market data vendors (Bloomberg B-PIPE / SAPI, Refinitiv/LSEG Elektron, ICE Data Services).
• Knowledge of Apache Airflow or similar workflow orchestration tools.
• Experience with Apache Iceberg, Delta Lake, or other open table formats for data lake management.
• Familiarity with risk or pricing platforms in asset management or insurance investment operations.
• AWS Professional or Specialty certifications (Data Analytics, Solutions Architect).

Details

• Location: Noida, India (Office).