Associate Data Engineer

Overview

Associate Data Engineer responsible for designing, developing, maintaining, and optimizing data pipelines, data models, and data warehouses that support business intelligence reporting and analytics.

What you'll do

• Configure data-movement solutions using approved patterns.
• Manage data integration and ETL jobs, including validation and data-quality routines.
• Deploy and execute automated production jobs while managing dependencies and schedules.
• Design, verify, and optimize data models based on business requirements.
• Collaborate with technical users and business stakeholders to define requirements and deliver datasets.
• Perform unit, system integration, and peer-review activities.
• Monitor errors, performance, data quality, and ETL optimization opportunities.

What you'll need

• At least 2 years of experience in data engineering.
• Knowledge of Python, Apache Kafka, AWS Redshift, AWS Glue, AWS S3, and Pentaho Data Integration.
• At least 2 years of data-modeling experience with data warehousing concepts and star or snowflake schemas.
• At least 2 years of hands-on ETL development experience.
• Knowledge of MPP database architecture and implementation.
• Knowledge of streaming pipelines using Apache Kafka, Apache Spark, or Segment.
• Bachelor's/College Degree in a listed technical field, or 4–8 years of experience in place of a degree.

Nice to have

• Three years of development using cloud-based analytics solutions, preferably AWS or GCP.
• Experience using Python in a cloud-based environment.
• Knowledge of NoSQL databases.
• Knowledge or exposure to AI tools.

Details

• Work from home.
• Remote position at any TaskUs India site.