Senior Data Engineer

Overview

Senior Data Engineer responsible for designing, developing, and maintaining scalable data infrastructure and data ingestion frameworks to support reporting.

What you'll do

• Design, develop, and maintain scalable data and file ingestion frameworks.
• Collaborate with cross-functional teams to understand and refine data requirements and translate them into technical solutions.
• Optimize ingestion frameworks for performance, scalability, and reliability.
• Implement data governance and data security best practices.
• Troubleshoot data integrity, application, and performance issues.
• Participate in code reviews and mentor junior engineers with technical guidance.

What you'll need

• 4–6 years of data engineering experience designing and implementing scalable data ingestion frameworks.
• Proficiency in ETL development and design using Python and PySpark.
• Experience with big data technologies including Apache Hadoop and Apache Spark.
• Strong SQL skills and experience with RDBMS such as PostgreSQL, Amazon Redshift, or MySQL.
• Hands-on experience with AWS including DynamoDB, EMR Serverless, and AWS Lambda.
• Deep understanding of data modeling, ETL processes, data ingestion, and data warehousing concepts.

Details

• Location: KA Bangalore.