Spark or Pyspark & Scala & Snowflake/ Databrick Developer

Overview

Design, build, and operate scalable backend systems for data ingestion, processing, validation, and reporting as a Senior Software Engineer.

What you'll do

• Build and maintain backend services, data pipelines, and APIs.
• Use AI tools for development, testing, debugging, documentation, and productivity.
• Design fault-tolerant, observable, and maintainable systems.
• Own solutions from design through operations.
• Implement data validation, reconciliation, and audit capabilities.
• Build and support CI/CD, monitoring, logging, and operational excellence.
• Mentor engineers and collaborate with product, analytics, and data teams.

What you'll need

• Strong experience with Scala or Python.
• Expertise in Spark or PySpark and distributed systems.
• Experience with Snowflake or Databricks.
• Strong SQL and relational database knowledge.
• Experience building APIs, data pipelines, and high-throughput systems.
• Experience with cloud platforms, CI/CD, and Docker or Kubernetes.
• Bachelor’s degree in Computer Science or a related field, or equivalent experience.

Nice to have

• Understanding of LLMs, prompt engineering, RAG, AI agents, and responsible AI practices.

Details

• Location: Bangalore, India.