Senior Big Data Engineer

Overview

Senior Big Data Engineer to extend and improve the Data Engineering Team by designing and leading scalable data solutions and pipelines.

What you'll do

• Design end-to-end data solutions including data lakes, data warehouses, ETL/ELT pipelines, APIs, and analytics platforms.
• Architect scalable, low-latency data pipelines for high-velocity streams using Kafka, Flink, or Spark Streaming.
• Design and orchestrate automation using orchestration frameworks such as Apache Airflow.
• Implement anomaly detection, alerts, and automated reroute/restart to maintain data integrity and availability.
• Define and implement data governance, metadata management, and data quality standards.
• Lead architectural reviews and technical design sessions to guide solution development.
• Ensure security, compliance, and regulatory requirements are addressed in all data solutions.

What you'll need

• 5+ years of experience in data architecture, data engineering, or a related field.
• Experience with Python, Java, or Scala.
• Proficiency with data pipeline tools such as Apache Spark, Kafka, and Airflow.
• Experience with data governance frameworks and tools (e.g., Collibra, Alation, OpenMetadata).
• Strong knowledge of cloud platforms such as Azure or Google Cloud.
• Experience working in Agile or DevOps environments.
• Experience with modern data stack tools such as dbt, Snowflake, and Databricks.