Data Engineer - Senior Engineer(Level 1)

Overview

Develop, optimize, automate, and maintain enterprise-scale ETL and data integration solutions using Azure data services, Python (PySpark), SQL, and Power BI.

What you'll do

• Develop, fine-tune, automate, and maintain ETL pipelines using Azure Data Factory, Azure Databricks, Python (PySpark), Azure SQL Database, and SQL Server Stored Procedures.
• Develop ETL solutions using data integration tools for interfacing between source applications and the Enterprise Data Warehouse.
• Document ETL data mappings, data dictionaries, processes, programs, and solutions according to established data governance standards.
• Integrate ETL development with existing projects to maximize object reuse.
• Create, execute, and document unit test plans for ETL and data integration processes and programs.
• Work with peers in the data team to assess and troubleshoot potential data quality issues at key intake points, such as validating control totals at intake.
• Troubleshoot data issues and defects to determine root cause.
• Perform performance tuning of ETL processes and SQL queries, and recommend and implement ETL and query tuning techniques.
• Develop and create transformation queries, views, and stored procedures for ETL processes and process automations.
• Work collaboratively with other team members and users for operational support.

What you'll need

• 5 years of experience.
• Be well-versed in the design and development of ETL solutions using Azure Data Factory, Azure Databricks, Python (PySpark), and SQL for large-scale data warehouses.
• Expertise in Azure Data Factory, Azure Databricks, Python (PySpark), Azure SQL Database, SQL Stored Procedure development, and performance tuning.
• Very good communication with strong business and data analysis skills.
• Experience using Agile methodologies.
• Experience developing and working on Power BI reports for enterprise-level reports.

Details

• Location: Pune, Blue Ridge-Hinjewadi, India.
• Employment type: Full time.
• Job category: Engineering Services.