Data Engineer

Overview

Data Engineer responsible for designing, developing, and maintaining data solutions and pipelines for data generation, collection, processing, and migration across systems.

What you'll do

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL.
• Build and manage ETL/ELT pipelines for batch and large-scale data processing.
• Implement and maintain Medallion Architecture (Bronze/Silver/Gold) for data structuring.
• Develop data transformation frameworks, optimize Spark workloads for performance and cost efficiency.
• Implement data quality checks and monitoring for seamless data flow and accessibility.
• Collaborate cross-functionally to translate requirements, troubleshoot production pipelines, and support enterprise-grade solutions.
• Mentor junior team members and contribute to team decisions.

What you'll need

• Minimum 5 years of experience in Data Engineering.
• Proficiency in Data Engineering.
• Hands-on expertise in Databricks, Python, PySpark, and SQL.
• Experience implementing Medallion Architecture across Bronze, Silver, and Gold layers.
• Strong knowledge of ETL/ELT design patterns and large-scale data processing.
• Ability to ensure data quality through validation and monitoring techniques.
• 15 years full time education is required.

Details

• Based in Hyderabad office.