Junior Data Engineer (Azure Databricks)

Overview

Junior Data Engineer specializing in Azure Databricks to build and support modern data pipelines and Lakehouse architectures within a data platform team.

What you'll do

• Support and evolve existing SQL Server data platforms and ETL solutions.
• Develop and maintain data pipelines using Azure Databricks.
• Build and optimize data transformations using PySpark and SQL in Databricks.
• Develop ETL/ELT pipelines orchestrated through Azure Data Factory.
• Integrate data from multiple sources into data platform and analytical layers.
• Maintain data models and data warehouse structures for analytics.
• Collaborate with BI teams to support Power BI and reporting platforms.

What you'll need

• 2+ years of experience in data engineering, data warehouse development, or a related field.
• Experience with Azure Databricks.
• Experience developing data pipelines using PySpark and Spark SQL.
• Understanding of distributed data processing and big data concepts.
• Good SQL skills and experience with SQL Server relational databases.
• Experience building data pipelines using Azure Data Factory.

Nice to have

• Knowledge of Spark optimization techniques such as partitioning, caching, and cluster tuning.
• Familiarity with Power BI and Databricks Structured Streaming.
• Experience migrating from traditional ETL to cloud architectures.
• Familiarity with Delta Lake and Lakehouse architectures.

Details

• Location: Barcelona, CT, Spain.