Data Engineer

Overview

Data Engineer on SiteMinder's Data & Business Systems team, serving as the central data hub for reporting and insights across the company, building and maintaining data pipelines and models on Databricks and AWS.

What you'll do

• Develop, test, and maintain high-quality, scalable ETL/ELT data pipelines using Python, PySpark, and Databricks on AWS
• Lead the development of new data features and services across the full product lifecycle, from architectural design to deployment, including technologies like Terraform and Spark Structured Streaming, DLT, etc.
• Create CI/CD controlled data engineering deployments using Databricks Asset Bundles and leverage Databricks serverless compute with cost optimization techniques
• Work within a fast-paced agile team with Product Managers, Data Scientists, and engineers to solve complex data challenges
• Help ensure the quality, integrity, and security of data throughout the data lifecycle, implementing best practices in data governance
• Take technical ownership of major components of the data platform architecture, leading design discussions
• Analyse workloads, queries, clusters/warehouses, jobs, and services to identify inefficiencies and savings opportunities
• Implement continuous monitoring and intelligence dashboards for cost and performance optimization
• Stay ahead of new Snowflake/Databricks features and translate them into product differentiators

What you'll need

• Extensive experience with data engineering, DataBricks and DBT (mandatory)
• Proven expertise in platform internals: Databricks clusters, jobs, Delta Lake, Spark optimization, autoscaling, Unity Catalog
• Strong SQL and Python skills for automation, monitoring, and recommendation logic
• Experience working with AWS data services
• Experience with frameworks like Terraform and Airflow
• Track record of delivering performance gains and cost savings through platform-level optimizations
• Startup mindset: hands-on, automation-driven, customer-value obsessed

Nice to have

• Databricks Certification
• Familiarity with compliance frameworks like SOC2, GDPR
• Knowledge of LLMs and AI frameworks

Details

• Hybrid working model with 3 days in-office
• Approximately 70% data engineering projects and 30% data operations