D

Lead Expert Data & AI Engineer - Manufacturing

dsm-firmenich
Posted a month ago

LOCATION

Hyderabad · Onsite

EXPERIENCE

5+ Years

SKILLS REQUIRED

PythonData Pipeline EngineeringSQLETL and ELTDatabricksData Quality TestingAzure DevOpsPySpark

Job description

Overview

Lead Expert Data & AI Engineer for Manufacturing, based in Hyderabad. You will design and maintain data pipelines, ensure seamless data integration and transformation, and lead team/project execution.

What you'll do

  • Evaluate project feasibility and recommend technical approaches.
  • Design and implement data pipeline architectures for ingestion, transformation, and storage.
  • Develop modular code for data transformation and integration.
  • Perform ETL-style ingestion from source systems when platform tables are unavailable.
  • Maintain and upgrade pipelines, troubleshooting issues to optimize performance.
  • Implement data quality testing and validation for data integrity and reliability.
  • Collaborate with data engineers, modelers, stewards, BI developers, data scientists, and SMEs.

What you'll need

  • 5 years of experience creating and maintaining data pipelines.
  • Expert knowledge of dbt, SQL, Python, and Spark (PySpark).
  • Expert knowledge of Git, Azure DevOps, and Databricks.
  • Experience with cloud engineering (AWS or Azure) and CI/CD pipeline deployment.
  • Strong problem-solving skills.
  • Ability to collaborate with data experts and SMEs for integration and transformation.
  • Hands-on experience designing automated deployment/automation pipelines across environments.

Details

  • Role location: Hyderabad, India.
  • Leadership includes team management, project oversight, and stakeholder engagement.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Lead Expert Data & AI Engineer - Manufacturing