Associate Data Engineer

Overview

Associate Data Engineer responsible for designing, building, maintaining, and interpreting data solutions to support actionable business insights.

What you'll do

• Design, develop, and maintain data solutions for data generation, collection, and processing.
• Create data pipelines and implement ETL processes to migrate and deploy data across systems.
• Develop and implement data pipelines and data integration solutions using ETL/ELT.
• Manage data pipeline projects from inception to deployment, including scope, timelines, and risks.
• Develop and maintain data models, data dictionaries, and documentation to ensure data accuracy and consistency.
• Implement data security and privacy measures and help resolve complex data-related challenges.
• Use cloud platforms (AWS preferred) to build scalable data solutions.

What you'll need

• 2 to 4 years of Computer Science/IT or related field experience.
• Hands-on proficiency in Databricks for building ETL pipelines and big data processing.
• Skills in Python, PySpark, and Scala for data processing and ETL workflows.
• Strong knowledge of SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
• Familiarity with big data frameworks such as Apache Hadoop, Spark, and Kafka.

Nice to have

• Experience with AWS data services (e.g., EKS, EC2, S3, EMR, RDS, Redshift/Spectrum, Lambda, Glue, Athena).
• Understanding of data modeling, data warehousing, and data integration concepts.
• Knowledge of machine learning pipelines and frameworks for ML/AI models.

Details

• Location: Hyderabad, India.