Software Engineering & Development, Officer

Overview

Officer - Babel Developer role in State Street Research IT to design, develop, support, and modernize the Babel platform for research data management and analytics.

What you'll do

• Design, develop, test, and maintain data pipelines using Python, PySpark, and SQL.
• Build and manage Databricks workflows for data ingestion and processing.
• Develop containerized applications and jobs using Docker.
• Write shell scripts to automate operational tasks and improve workflow efficiency.
• Collaborate with cross-functional teams to define requirements and deliver scalable solutions.
• Design and maintain CI/CD pipelines using tools such as Jenkins, Artifactory, and Bitbucket/GitHub.
• Troubleshoot production issues by analyzing logs and supporting fast resolution.

What you'll need

• 7+ years of experience in technology and/or data functions in financial services or consulting.
• Hands-on experience with Databricks and its ecosystem, including Spark architecture.
• Proven ability to build and manage workflows, data pipelines, and applications on Databricks.
• Hands-on development of Python-based applications (e.g., Streamlit) on Databricks or similar cloud platforms.
• Development skills in Python, PySpark, SQL, and shell scripting.
• Exposure to cloud platforms, preferably AWS services (e.g., S3, EMR, Lambda, ECS/EKS, Glue, IAM).
• Experience with CI/CD tools such as Artifactory and Jenkins/Bitbucket.

Details

• Location: Bangalore, India.