Senior Big Data Engineer

Overview

Senior Big Data Engineer to design, build, and operate core components of a data platform and pipeline architecture for processing billions of daily transactions.

What you'll do

• Design, build, and maintain high-throughput data platform and pipeline components using Spark and Kafka.
• Debug, tune, and optimize Spark jobs and Kafka pipelines for growing data volumes.
• Collaborate with product, professional services, and sales engineering teams on architecture design and technical trade-offs.
• Establish and refine technical standards, system documentation, and best practices across the engineering team.
• Mentor junior and mid-level engineers on complex technical issues and pipeline performance.

What you'll need

• Minimum 5 years of experience in data engineering or big data platform development.
• Bachelor's degree in Computer Science, Computer Engineering, or a related technical field.
• Experience designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka.
• Hands-on experience scaling data platform infrastructure for high-volume/high-throughput transaction workloads.

Nice to have

• Experience in high-volume, multi-tenant enterprise platform environments.
• Proficiency in Scala, Java, or Python for data processing applications.
• Proven experience mentoring junior or mid-level engineering team members.