Associate Data Engineer

Overview

As an Associate Data Engineer on the data platform and product insights data engineering team, you will build and support data pipelines, data platforms, monitoring systems, data warehouses and data marts in a cloud-native environment. Your work will support actionable insights into product efficacy, the marketing platform, customer behaviour and retention.

What you'll do

• Build and support data ingestion and processing pipelines for extracting, loading and transforming big data from a wide variety of batch and streaming sources.
• Build real-time monitoring dashboards and alerting systems.
• Partner with product to assemble large, complex data sets that meet functional and non-functional business requirements.
• Build out data dictionaries and data catalogs.
• Create detailed documentation and knowledge around data assets, metrics and KPIs.
• Warehouse data and build data marts, data aggregations, metrics, KPIs and business logic.
• Develop data solutions that lead to actionable insights into product efficacy, the marketing platform, customer behaviour and retention.

What you'll need

• 1-3 years of experience in Big Data and Data Engineering.
• Strong knowledge of SQL.
• Experience working with relational databases and working familiarity with a variety of databases.
• Hands-on experience with modern data platform components such as Spark and Python.
• Experience setting up and maintaining data warehouses such as Google BigQuery, Redshift or Snowflake for an organization.
• Experience setting up and maintaining data lakes such as GCS or AWS S3 for an organization.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra / MongoDB.
• Experience with data pipeline and workflow management tools such as Airflow, Dataflow or Dataproc.
• Experience with distributed versioning control environments such as GIT or Azure DevOps.
• Experience building Docker images and fetching, promoting and deploying them to Production.
• Experience integrating a Docker container orchestration framework using Kubernetes by creating pods, config Maps and deployments using terraform.
• Strong problem-solving and communication skills.
• Bachelor’s or an advanced degree in Computer Science or a related engineering discipline.

Nice to have

• Experience with one of the cloud providers – GCP, Azure or AWS.
• Exposure to Business Intelligence tools such as Tableau, Dundas or Power BI.
• Experience with Agile software development methodologies.
• Experience working in multi-functional, multi-location teams.

Details

• Location: Gurugram, Haryana.
• This is a hybrid role with in-office expectations determined by location and subject to change based on evolving business needs.