Associate Developer – Data Engineering

Overview

As an Associate Developer, Data Engineering, you will be part of the Data & Analytics Platform Engineering Team, designing, developing, testing, and supporting platform foundational frameworks in Amazon Web Services (AWS) and Databricks.

What you'll do

• Design, develop, and maintain scalable data pipelines with delta mechanism in the AWS Lake using AWS services and PySpark.
• Analyse, design, develop, test, deploy, and support data models in AWS S3 using Spark SQL based on extracts from various sources and functional design specifications.
• Build and administer data ingestion frameworks in Databricks using PySpark and SQL and manage Platform Engineering tasks.
• Review business requirements and create functional and technical design documents, data lineage, data dictionaries, and metadata management, including SQL scripting.
• Stay current with industry trends and best practices in data engineering, Databricks, AWS services, AWS Lakehouse, PySpark, and Athena while participating actively in local and global teams.

What you'll need

• Bachelor's degree or higher (completed and verified prior to start).
• Two (2) to four (4) years of solid experience in data warehousing, including data pipelines and data modeling, particularly on AWS and Databricks platforms, in a private, public, government or military environment.

Nice to have

• Two (2) to three (3) years of strong experience in Python and PySpark with SQL scripting, plus hands-on experience with AWS services such as S3, Amazon EKS, Amazon EMR, CloudFormation, AWS Secrets Manager, Glue, and Athena.
• Two (2) to three (3) years of solid experience with Databricks, including automated user provisioning, RBACs, ABACs, AI/ML, and workspace management, along with good experience in relational databases and concepts.
• Extensive working knowledge of one or more business processes such as sales, finance, supply chain, manufacturing, or Master Data.
• Detail-oriented, self-directed problem solver with strong analytical and multitasking skills, a strong interest in technology, and English fluency.

Details

• Location: Hebbal, Bangalore (Karnataka), India.
• Work mode: Hybrid.