Data Engineer

Overview

Accenture is hiring a Data Engineer to design, develop, and maintain data solutions and pipelines for data generation, collection, and processing.

What you'll do

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, Python, and SQL.
• Build and manage ETL/ELT pipelines for batch and large-scale data processing.
• Implement and maintain Medallion Architecture across Bronze, Silver, and Gold layers.
• Develop data transformation frameworks, optimize Spark workloads, and improve performance and cost efficiency.
• Implement data quality checks and monitoring for continuous validation.
• Lead design and implementation of scalable data architectures and coordinate cross-functional efforts to optimize workflows.
• Mentor junior team members and contribute to team decisions.

What you'll need

• Minimum 5 years of experience in Data Engineering.
• Proficiency in Data Engineering.
• Hands-on expertise in Databricks, Python, PySpark, and SQL.
• Solid hands-on experience implementing Medallion Architecture (Bronze/Silver/Gold).
• Deep understanding of ETL/ELT design patterns and large-scale data processing.
• Strong knowledge of data storage solutions and database management.
• Competence in scripting and programming languages relevant to data processing.

Details

• Location: Hyderabad office.