Senior Data Engineer

Overview

Senior Data Engineer in Citi's Applications Development group, participating in establishing and implementing new or revised application systems and programs with the Technology team.

What you'll do

• Develop the data warehouse, develop data as a product, and lead architecture and solution development, maintenance of scalable and secure data architecture to support downstream and reporting applications and data integration.
• Simplify complex data processes using best engineering practices and data lifecycle management.
• Develop data models, taxonomies, metadata, data mappings, data standards, versioning, and semantic layers for domains and data products, supporting data consumption, AI and regulatory requirements.
• Build automated data integration solutions and data pipelines, including reference data, to meet business and reporting requirements.
• Exhibit strong leadership, fostering a positive and collaborative work environment, providing guidance and mentorship to team members, and promoting continuous learning.
• Implement data governance and management, quality standards and data controls to ensure data accuracy and security.
• Manage and maintain data process documentation.
• Contribute to technical direction and enhancement as a technical expert in data development and implementation phases, providing in-depth analyses to define problems and develop innovative solutions.
• Work closely with business users, stakeholders, BAs, product managers and other development teams to understand the problem space, brainstorm ideas, approaches and solutions.
• Contribute to CI/CD implementation using DevOps best practices and ensure a robust testing framework is used for functional and nonfunctional testing across release cycles, based on industry and Citi standards.
• Demonstrate a data-driven approach to problem-solving and decision-making, using metrics and performance indicators to assess team efficiency and identify improvement opportunities.
• Manage and maintain data processes and jobs.
• Partner with the Support team to ensure stability of the production environment through proactive monitoring and health checks.
• Partner with other Citi development teams to build APIs, integrations and shared components critical to the platform's success.

What you'll need

• Strong experience designing and building best-in-class enterprise data engineering solutions in a highly matrixed, complex organization.
• Strong experience architecting complex end-to-end data pipelines in highly available, distributed systems for data extraction, ingestion and processing of large data sets.
• Strong hands-on advanced development experience with large databases, complex data models, procedures, error handling, performance tuning/profiling, data security, database optimization and configurations.
• Solid experience in complex data integration.
• Strong experience in large complex physical and logical data model design and development for data warehouse, reporting, and reference and master data.
• Hands-on experience with complex data integration and developing scalable, high-volume data pipelines using APIs, Python, Airflow and Spark.
• Experience in data mesh technologies: Trino/Starburst, S3, distributed stream processing with Kafka.
• Strong experience developing data quality and reconciliation controls, data lineage and data catalog documentation, data control monitoring, and proactively identifying and resolving data inconsistencies and gaps.
• Excellent verbal and written communication skills, enabling effective collaboration with cross-functional teams, stakeholders and management.
• Strong hands-on experience with modern software paradigms including cloud-native (AWS, Docker) and microservices.
• Experience implementing DevOps, including CI/CD and modern best practices such as testing frameworks and the SOLID principles; CI/CD tooling and automation of testing tools.
• Passion and commitment for adopting new technologies with an exploratory mind-set.
• Experience working in an Agile/Scrum work environment.
• Experience building observability and monitoring for data processes and jobs.
• Innovative ideas and a can-do attitude to work under pressure.
• Experience building data quality control and monitoring.
• Understanding of trading data and experience working in financial services is required.
• Proficiency with modern AI coding and testing tools.
• 7 to 10 years of relevant experience (recommended).
• Experience in systems analysis and programming of software applications (recommended).
• Experience managing and implementing successful projects (recommended).
• Working knowledge of consulting/project management techniques/methods (recommended).
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements (recommended).
• Bachelor's degree/University degree or equivalent experience.

Nice to have

• Strong hands-on experience in S3, Starburst, Oracle database, Databricks and Snowflake.
• Development DBA experience.

Details

• Location: Pune, Maharashtra, India.
• Time type: Full time.
• Job family: Applications Development (Technology).