Data Engineer

Overview

Data Engineer role focused on building and optimizing scalable data pipelines and analytical datasets on an AWS-based lakehouse platform.

What you'll do

• Develop and maintain batch data pipelines.
• Build reusable ingestion and transformation workflows.
• Build and maintain Apache Iceberg datasets.
• Support schema evolution and partition optimization.
• Optimize Athena queries and troubleshoot performance bottlenecks.
• Implement data validation checks and monitoring.
• Support production issue troubleshooting.

What you'll need

• 4–5 years of experience in data engineering.
• Hands-on experience with Python and SQL.
• Experience with PySpark/Spark.
• Experience with AWS S3, Glue, and Athena.
• Experience with dbt and Airflow (or equivalent).
• Familiarity with Apache Iceberg/Hudi/Delta.
• Familiarity with partitioning and Parquet optimization.

Details

• Fair understanding of Information Security practices and alignment to organization ISMS policies.