Data Engineer

Overview

Data Engineer responsible for building and maintaining scalable data solutions for reporting, analytics, ML, and AI, aligned to group standards and timelines.

What you'll do

• Understand requirements and ensure deliverables align with customer needs.
• Build processes to ingest, process, and store large volumes of data.
• Wrangle data to support data science projects.
• Optimize performance of big data ecosystems.
• Construct, test, and maintain scalable solutions for structured and unstructured data.
• Develop data pipelines and support feature engineering.
• Collaborate on project risk identification, mitigation planning, and estimates.

What you'll need

• Bachelor of Science in a related field.
• 5 years of design and development experience.
• Experience with Azure Databricks, data factory, and Azure Storage (ADLS).
• Knowledge of CRISP-DM methodology relevant to data engineering.
• Advanced knowledge of business intelligence and data warehousing.
• Performance tuning and code optimization in SQL.
• Experience with SQL, C#, .NET, Python, and Linux shell scripting (or related tools listed).