Data Engineer II

Overview

Data Engineer II responsible for leading the design, development, and maintenance of complex data engineering projects and pipelines for the G2 data platform.

What you'll do

• Lead the design and development of data pipelines to integrate sources into the G2 Data Platform.
• Optimize pipelines for cost effectiveness, scalability, and reliability.
• Implement complex ETL and ELT processes in an AWS and Snowflake ecosystem.
• Service data requests from users of the G2 data platform.
• Contribute to data modeling and design reviews to improve adoption and efficiency.
• Own data quality and data governance initiatives and drive them to completion.

What you'll need

• 4+ years of experience as a data engineer or ETL developer.
• 2+ years of development experience in data modeling, optimization, and database architecture.
• Experience designing and developing data pipelines using cloud and open-source tools.
• Proficiency in writing and debugging SQL queries.
• Good programming skills in Python or Java.
• Working knowledge of AWS data services and cloud data warehouses like Snowflake.
• Familiarity with distributed computing frameworks like Apache Spark, Hadoop, and Apache Kafka.