Data Engineer

Overview

As a Data Engineer, you will design, develop, and maintain data solutions for data generation, collection, and processing. You will create data pipelines, ensure data quality, implement ETL processes, and provide effective solutions aligned with data needs and organizational goals.

What you'll do

• Design, develop, and maintain data solutions for data generation, collection, and processing.
• Create data pipelines.
• Ensure data quality.
• Implement ETL processes to migrate and deploy data across systems.
• Collaborate with cross-functional teams to understand their data needs and provide effective solutions.
• Ensure that the data architecture aligns with organizational goals and standards.
• Monitor and optimize data workflows to enhance performance and reliability.
• Perform as a subject matter expert.
• Collaborate with and manage the team to perform.
• Make team decisions.
• Engage with multiple teams and contribute to key decisions.
• Provide solutions to problems for the immediate team and across multiple teams.
• Facilitate knowledge sharing and training sessions to enhance team capabilities.
• Continuously evaluate and improve data processes to ensure optimal performance.

What you'll need

• Minimum 7.5 year(s) of experience is required.
• Minimum 7.5 years of experience in GCP - Vertex AI.
• 15 years full time education.
• Proficiency in GCP - Vertex AI.
• Experience with data pipeline orchestration tools such as Apache Airflow or Google Cloud Dataflow.
• Strong understanding of ETL processes and data warehousing concepts.
• Familiarity with data modeling techniques and best practices.
• Experience in programming languages such as Python or Java for data manipulation.

Details

• Based at the Mumbai office.