Data Engineer

Overview

Data Engineer on the Data & AI/ML team, owning the cloud-scale data backbone that powers Priceline's company-wide analytics and machine learning models.

What you'll do

• Participate in cloud migration and modernization of current data systems.
• Oversee data systems that serve millions of events a day.
• Maintain and design early warning and analytics systems using cutting-edge big data technologies.
• Collaborate on building software that collects and queries data, and compose queries for investigation purposes.
• Analyze and provide data-supported recommendations to improve product performance and customer acquisition.
• Diagnose and troubleshoot issues within data infrastructure.
• Collaborate in team efforts, mentor junior team members, and converse respectfully and compromise when necessary.

What you'll need

• Bachelor's degree in Computer Science or a related field.
• Minimum of 4 years of experience in software engineering and development, with a strong focus on Big Data technologies and data-driven solutions.
• Demonstrated expertise in Big Data solutions, including frameworks such as Apache Spark and Kafka.
• Advanced knowledge in data modeling and schema design for optimized data storage and retrieval.
• Strong command of databases, including Cloud SQL (MySQL, PostgreSQL), BigQuery, and Oracle.
• Extensive experience with GCP tools, specifically Dataflow and Dataproc, for building and managing large-scale data processing pipelines.
• Proficiency in data orchestration frameworks, particularly Apache Airflow, for scheduling and managing complex workflows.
• Proven ability to analyze, debug, and resolve data processing issues efficiently.
• Proficient in Python/Java/Scala, with the ability to write efficient, maintainable code in any language.

Nice to have

• Proficiency in the Google Cloud Platform (GCP) stack.
• Experience with enterprise ETL tools such as Informatica (PowerCenter or similar), especially for migrating legacy batch processes into GCP-based pipelines.
• Experience with data visualization tools, such as Tableau, for representing data insights.
• Familiarity with advanced data processing strategies, including indexing, machine-learned ranking algorithms, clustering techniques, and distributed computing concepts (advanced concepts of Spark).
• CI-CD experience with GitHub, GitHub Actions, Jenkins, and Maven.

Details

• Location: Mumbai.
• Hybrid work model: two days onsite (ideally Tuesday, Wednesday, or Thursday), remaining days remote or in office at your choice.