Sr Data Engineer

Overview

Seeking a Senior Data Engineer to drive development and implementation of the company data strategy.

What you'll do

• Design, develop, and implement data pipelines, ETL/ELT processes, and data integration solutions.
• Own data pipeline projects from inception through deployment while managing scope, timelines, and risks.
• Ensure data quality and integrity via testing and monitoring.
• Build scalable data solutions on cloud platforms (AWS preferred).
• Collaborate with data analysts, data scientists, and business stakeholders on data requirements.
• Identify and resolve complex data-related challenges and follow data engineering best practices.

What you'll need

• 8 to 13 years of experience.
• Hands-on experience with cloud platforms (AWS, Azure, GCP) and cost-effective, scalable data solutions.
• Proficiency in Python, PySpark, and SQL.
• Experience with big data ETL performance tuning.
• Strong analytical and problem-solving skills for complex data challenges.
• Effective communication and interpersonal skills for cross-functional collaboration.

Nice to have

• Experience with data modeling and performance tuning for OLAP and OLTP databases.
• Experience with Apache Spark and Apache Airflow.
• Experience with software engineering best practices including version control (Git/Subversion) and CI/CD (Jenkins/Maven), automated unit testing, and DevOps.
• Cloud services experience with AWS, GCP, or Azure.
• AWS Certified Data Engineer and/or Databricks certification.

Details

• Role: Senior Data Engineer.
• Department/team: OCX Team 2: Sky Links (SL) - HZN RDBU.