Overview
Associate Data Engineer in the Data COE, designing and building scalable, secure and cost-effective cloud-based data solutions and maintaining the pipelines that feed data warehouses and data lakes.
What you'll do
- Design and build scalable, secure, and cost-effective cloud-based data solutions.
- Develop and maintain data pipelines to extract, transform, and load data into data warehouses or data lakes.
- Implement data quality and validation processes to ensure data accuracy and integrity.
- Ensure efficient data processing of pipelines and data storage for optimal retrieval performance.
- Be an integral part of the delivery team, coordinating closely within the assigned team to complete deliverables on time and in line with data engineering guidelines and standards.
- Collaborate with data teams, product owners, and other stakeholders, and keep up to date with the latest cloud technologies and best practices.
What you'll need
- 2 to 4 years of data engineering experience with good expertise in the required tech stack.
- Using data analysis to make recommendations to analytic leaders.
- Understanding of best-in-class analytics practices.
- Knowledge of KPIs and scorecards.
- Programming: Python, PySpark, SQL.
- ETL and integration: Databricks (LDP, Lakeflow Connect, Notebooks), AecorSoft/DataSphere.
- Data warehousing: SCD types, fact and dimensions, star schema, ETL.
- Medallion architecture: Bronze, Silver, Gold (Databricks Medallion Architecture).
- AWS cloud services: S3, Lambda, EC2, Glue, Redshift.
- Scheduling technologies: Lakeflow Jobs, Airflow.
- Soft skills: problem-solving, communication, analytical thinking, attention to detail, adaptability.
Nice to have
- Knowledge of BI tools such as Tableau, Excel, Alteryx, R, Python, etc.
- Data modeling: dimensional modelling understanding, Erwin tool (optional).
- GenAI exposure: Genie/Kiro/Gemini etc.
- Visualization: PowerBI, GenBI (optional).
Details
- Location: Mumbai, India.
- No relocation support available.
- Job type: Regular.
Read the full description and apply on the company’s own careers page.