Senior Data Engineer II

Overview

Senior Data Engineer II responsible for building scalable data platforms, pipelines, APIs, and AI-enabled tooling. The role supports data integration, analytics, automation, and production data operations.

What you'll do

• Develop end-to-end data pipelines and backend ingestion workflows.
• Design and operate Spark and PySpark workflows for batch and streaming processing.
• Build and manage Python data APIs using frameworks such as FastAPI.
• Improve data architecture, quality, monitoring, observability, and availability.
• Build MCP servers and integrate AI-agent workflows into data engineering.
• Provide production support through on-call rotations and technical escalation.
• Lead projects, mentor junior team members, and guide cross-functional stakeholders.

What you'll need

• Bachelor's degree in computer science, data engineering, data science, information technology, or an equivalent engineering program.
• 10+ years of experience as a software engineer with a data focus or as a data engineer.
• 8+ years of experience building production-grade data pipelines and data models.
• 5+ years of production Spark or PySpark experience, including performance tuning.
• 3+ years of experience developing and managing APIs, preferably in Python.
• Strong Python and SQL skills with cloud data warehouse or lakehouse experience.
• Experience with cloud platforms, relational databases, ETL tools, and API management.

Nice to have

• Experience designing a centralized semantic layer for AI and analytics.
• Experience with Splunk, DataDog, AWS CloudWatch, or equivalent monitoring tools.
• Experience with AWS serverless services including API Gateway, Lambda, S3, SNS, SQS, and Secrets Manager.

Details

• Remote role open to candidates residing in the United States and Canada, excluding the San Francisco Bay Area and New York Metro City.
• Annual base salary: USD 134,470–203,400.