Backend Engineer - Search

Overview

Design and maintain scalable data pipelines that ingest, process, enrich, and index data for enterprise search applications. The role supports secure, reliable search experiences across multiple data sources.

What you'll do

• Design, develop, and maintain data pipelines for enterprise search applications.
• Implement ingestion from databases, file systems, and APIs.
• Develop transformation and enrichment processes for indexing.
• Integrate search platforms to index and update data efficiently.
• Monitor pipeline performance and troubleshoot issues.
• Implement security measures for sensitive data processing and storage.
• Document pipeline architecture, processes, and best practices.

What you'll need

• Proficiency in Python, Java, or Scala.
• Experience with Apache Airflow, Apache NiFi, or similar data pipeline tools.
• Experience with Elasticsearch or OpenSearch.
• Familiarity with data ingestion, transformation, and indexing.
• Understanding of crawling, indexing, and query processing.
• Knowledge of data security and access control best practices.
• Experience with AWS, GCP, or Azure.

Nice to have

• Familiarity with Model Context Protocol (MCP).

Details

• Based in the Bengaluru office.