Data Engineer

Overview

Data Engineer role focused on designing, developing, and maintaining data solutions and pipelines, including ETL/ELT processes and data quality.

What you'll do

• Build, maintain, and optimize scalable data pipelines for large-scale processing.
• Develop ETL/ELT processes using PySpark and Spark to transform data from multiple sources.
• Design and deploy data solutions across AWS, Azure, or GCP.
• Implement and support real-time streaming and batch data processing pipelines.
• Collaborate to ensure data accuracy, availability, and secure data ingestion.
• Maintain reusable ETL code and tune Spark job performance for scalability.

What you'll need

• Minimum 3 years of experience is required.
• Experience with Databricks Unified Data Analytics Platform (must have).
• Strong proficiency in PySpark, Spark, or similar frameworks.
• Good understanding of Big Data architectures and data processing concepts.
• Knowledge of SQL and database technologies.
• Familiarity with data formats like Parquet, Avro, or JSON.

Details

• Location: Bengaluru.