A

Mid-Senior Databricks Engineer

Artingdigital
NewPosted yesterday

LOCATION

Remote

EXPERIENCE

3 - 6 Years

TYPE

FullTime

SKILLS REQUIRED

DatabricksPySparkPythonData PipelinesDelta Live TablesDelta LakeETL PipelinesPerformance TuningSQL

Job description

Overview

Mid-Senior Databricks Engineer role focused on building and optimizing scalable data pipelines.

What you'll do

  • Develop and maintain scalable data pipelines using Databricks, Python, and PySpark.
  • Build and automate ETL workflows using Delta Live Tables (DLT).
  • Optimize Spark jobs through partitioning, shuffling, and performance tuning.
  • Implement Delta Lake optimization techniques, including Z-Ordering and VACUUM.
  • Manage data orchestration using Airflow or Azure Data Factory.
  • Ensure data quality, governance, and pipeline performance.
  • Collaborate with cross-functional teams to deliver efficient data engineering solutions.

What you'll need

  • 3–6 years of experience in Data Engineering.
  • Strong knowledge of SQL, Python, and PySpark.
  • Hands-on experience with Databricks and Apache Spark.
  • Understanding of Spark optimization, partitioning, and shuffling.
  • Experience with Delta Lake, Z-Ordering, and VACUUM.
  • Experience building ETL pipelines using Delta Live Tables (DLT).
  • Knowledge of Apache Airflow or Azure Data Factory.
  • Understanding of data governance and data quality.

Details

  • Location: Remote.
  • Employment type: Full-Time.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Mid-Senior Databricks Engineer