Software Development Engineer 4

Overview

Role is for a Lead Data Engineer at Adobe in Noida, focused on building an AI-powered data platform for analytics.

What you'll do

• Build data applications using Python and LLMs to automate and enable sales insights.
• Develop a data platform using big data processing and warehousing technologies.
• Design, maintain, and improve frameworks and tools for ingesting, storing, processing, and serving data.
• Create data pipelines to publish reports and power client dashboards.
• Collaborate with cross-functional teams to define project interfaces and build them with quality and agility.
• Analyze data and present findings to leaders for data-driven business and product decisions.
• Support ML engineers and data scientists with dataset needs for training and evaluation.

What you'll need

• Bachelor’s degree in computer science or related fields.
• 8-12 years of experience as a server-side developer, including at least 4 years in data engineering.
• Strong understanding of LLMs and how they can be repurposed for business problems.
• Programming expertise in Java or Python with data engineering-focused frameworks and libraries.
• Expertise with big data technologies including Delta Lake, Apache Hive, Datahub, Apache Spark, Apache Flink, Apache Storm, Trino, and AWS EMR.
• Knowledge of orchestration tools such as Airflow or Oozie.

Details

• Location: Noida.