RBS logo

Data Engineer – Python, PySpark & AWS, AVP

RBS
NewPosted yesterday

LOCATION

Bengaluru · Onsite

EXPERIENCE

8+ Years

TYPE

FullTime

SKILLS REQUIRED

PySparkPythonAWSData PipelinesData ModelingPostgreSQLData WarehousingETL Development

Job description

Overview

Build data pipelines, data models and ETL designs, including streaming data ingestion, to deliver digital-first customer experiences. This is an Associate Vice President level role.

What you'll do

  • Develop a comprehensive knowledge of data structures and metrics, and advocate for change when needed for product development.
  • Provide transformation solutions and carry out complex data extractions.
  • Develop a clear understanding of data platform cost levels to build cost-effective and strategic solutions.
  • Source new data using the most appropriate tooling and integrate it into the overall solution to deliver it to customers.
  • Drive customer value by understanding complex business problems and requirements to apply the most appropriate and reusable tools to build data solutions.
  • Participate in the data engineering community to deliver opportunities supporting the strategic direction.
  • Carry out complex data engineering tasks to build a scalable data architecture and transform data so it is usable to analysts and data scientists.
  • Build advanced automation of data engineering pipelines through the removal of manual stages.
  • Lead the planning and design of complex products and provide guidance to colleagues and the wider team when required.

What you'll need

  • Understanding of data usage and dependencies with wider teams and the end customer.
  • Experience of extracting value and features from large-scale data.
  • Experience of ETL technical design, data quality testing, cleansing and monitoring, data sourcing, exploration and analysis, and data warehousing and data modelling.
  • At least eight years of experience building and supporting enterprise-scale data pipelines and analytics solutions using advanced Python and PySpark for large-scale batch and real-time processing.
  • Strong experience in data warehousing, including dimensional modelling, star and snowflake schemas, fact and dimension design, SCD, ETL/ELT frameworks, data lake and data warehouse architectures, data quality and governance.
  • Strong expertise in PostgreSQL database design, optimisation and query tuning.
  • Strong experience with AWS services including S3, Glue, EMR, Lambda, RDS, ECS/EKS, CloudWatch, IAM and API Gateway.
  • Experience translating business requirements into HLD/LLD documents and designing secure, scalable and resilient integration patterns for enterprise applications and data platforms.
  • Experience with CI/CD pipelines, multi-environment release management, automated testing and production troubleshooting with root-cause analysis.
  • Strong Agile delivery experience with Product Owners, Architects and business stakeholders, including Jira, sprint planning, estimation, backlog grooming and retrospectives.

Nice to have

  • Exposure to AI-assisted development tools such as Kiro and Copilot.
  • Experience mentoring engineers.

Details

  • Location: Bengaluru.
  • Hours: 45 per week.
  • Job posting closing date: 23/11/2026.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Data Engineer – Python, PySpark & AWS, AVP