Senior Data Engineer

Overview

Design, build and maintain scalable data pipelines and data platforms that enable analytics, reporting and data-driven decision-making, working closely with data engineers, software engineers, business stakeholders and data analysts.

What you'll do

• Design, develop and maintain robust ETL/ELT pipelines for batch and real-time data processing.
• Build scalable and reusable data solutions to support analytics, reporting and operational use cases.
• Develop and optimize data ingestion, transformation and data-serving frameworks.
• Ensure high data quality, integrity, reliability and availability across platforms.
• Build and support cloud-native data platforms using AWS services.
• Develop scalable data processing solutions leveraging AWS Glue, S3, Athena, Lambda, Redshift, EKS and DynamoDB.
• Support infrastructure automation and platform modernization initiatives.
• Implement data quality controls, monitoring and validation frameworks.
• Contribute to metadata management, data lineage and governance initiatives.
• Ensure compliance with enterprise security, privacy and regulatory standards.
• Collaborate with architects, product owners, business analysts and engineering teams.
• Participate in solution design reviews and technical decision-making.
• Build and maintain automated CI/CD pipelines for data platforms.
• Implement observability, logging, monitoring and alerting solutions.

What you'll need

• 6-9 years of experience in Data Engineering, Software Engineering or a related discipline.
• Strong programming skills in Python, Java or Scala.
• Strong experience with AWS cloud services.
• Containerization and orchestration using Docker and Kubernetes/EKS.
• Data engineering tools: Apache Spark and/or Kafka.
• Education: BE or any Bachelor of Engineering.

Nice to have

• Python, Java or Scala (preferred).

Details

• Location: Bangalore, Manyata Tech Park.
• Business unit: Corp Tech.
• Existing Commonwealth Bank Group employees (including Bankwest and x15ventures) must apply through Sidekick.