Databricks Engineer (Remote, US)

Overview

Build and optimize production data pipelines on the Databricks Lakehouse for enterprise customers, working under a senior engineer or architect and owning a defined piece of an engagement end to end.

What you'll do

• Build and maintain batch and streaming ETL pipelines using PySpark, SQL, and Delta Lake on Databricks
• Implement Medallion architecture layers
• Deploy and manage data resources on AWS, Azure, or GCP
• Write and automate data validation and quality checks
• Tune Spark jobs and SQL queries for performance and cost
• Structure and clean enterprise datasets for downstream analytics and AI workloads
• Troubleshoot pipeline failures and data quality issues, including in production
• Work client-facing in standups and working sessions, explaining technical trade-offs to stakeholders

What you'll need

• 8+ years in data engineering/architecture or analytics platform development
• Demonstrated ownership of end-to-end architecture for at least two enterprise-scale data platforms, from design through production
• Deep experience migrating legacy data warehouses or ETL estates to a modern cloud platform (Teradata, Informatica, Hadoop, Netezza, or equivalent)
• Strong proficiency in Python and SQL; working knowledge of Apache Spark and distributed processing fundamentals
• Experience with data modeling across dimensional, normalized, and Lakehouse patterns, and the judgment to know when each applies
• Experience with CI/CD and DevOps practices for data platform deployment

Nice to have

• Healthcare or life sciences experience
• Databricks Certified Data Engineer Professional or a Platform Architect certification
• Hands-on Databricks experience at scale: Unity Catalog, Delta Lake, Lakeflow, Asset Bundles
• Experience with MLOps or productionizing machine learning workloads
• Prior professional services, consulting, or customer-facing architecture background
• Experience contributing to pre-sales scoping or technical proposals

Details

• Remote/WFH, United States
• Certification roadmap built for each technical hire, taught in-house by Databricks-approved trainers
• Dedicated Employee Success Manager
• Benefits include unlimited PTO, health (medical, dental, vision), retirement plan (401k, IRA), life insurance, family leave, short and long term disability, and training and development