Data Engineer - Python, AI

Overview

Mid-level Data Engineer role combining Python development with AI/NLP engineering. You will build NLP pipelines and large-scale data processing workflows, along with APIs and deployment automation.

What you'll do

• Develop and optimize ETL/data processing jobs using PySpark and Pandas.
• Build and maintain NLP pipelines using Flair, BERT, and LLM-based models.
• Develop scalable ingestion and data transformation pipelines for AI and analytics.
• Build Flask-based APIs for model inference and service integrations.
• Integrate caching and fast lookups using Redis.
• Manage ML models with MLflow for tracking and versioning.

What you'll need

• 10–12 years of hands-on Python programming experience.
• Strong fundamentals in Python, OOP, and design patterns.
• Experience with NLP libraries such as Flair, BERT, HuggingFace Transformers, or similar.
• Solid experience with PySpark, Pandas, and PyArrow for distributed data pipelines.
• Experience building APIs using Flask (FastAPI is a plus).
• Experience with MLflow for model tracking and deployment.
• Experience with Redis (or similar in-memory stores).

Details

• Location: Pune, Maharashtra, India.
• Employment type: Full time.