Senior Data Engineer

Overview

Senior Data Engineer role responsible for leveraging business intelligence, data analytics, data modeling and big data technologies to turn complex data into actionable insights that support strategic decision-making, and for ensuring effective information management across the organization.

What you'll do

• Design and implement Lakehouse-based data architectures, including Medallion Architecture (Bronze, Silver, Gold layers), using configuration-driven and reusable frameworks to support multiple product teams.
• Build, optimize and maintain high-volume, high-velocity, high-variety data pipelines for batch and streaming workloads using Azure Databricks, Databricks, PySpark and SQL.
• Lead the design and development of data ingestion pipelines, data lake storage solutions, transformation notebooks, physical data models, tabular models, APIs/endpoints and data visualization solutions.
• Partner with business and product stakeholders to gather functional requirements, user stories and product backlog items (PBIs), translating them into scalable technical solutions.
• Define technical architecture, establish engineering standards and provide technical direction across data engineering initiatives.
• Develop and maintain reusable data engineering frameworks to improve scalability, consistency and maintainability across projects.
• Implement and support enterprise-grade data governance, quality, security and performance optimization practices.
• Collaborate with cross-functional teams, including Data Science, Analytics and AI teams, to enable advanced analytics and AI-driven solutions.
• Utilize Databricks Mosaic AI, LangGraph or similar GenAI frameworks within enterprise guardrails to enhance data engineering workflows and accelerate solution delivery.
• Mentor and guide junior engineers, conduct design reviews and promote best practices in data engineering and software development.

What you'll need

• Bachelor's Degree in Information Technology, Computer Science, Computer Engineering, Software Engineering, Data Science, Information Systems, or a related field.
• At least 8–12 years of experience in Data Engineering, Data Platform Development, Data Warehousing, or related data and analytics roles.
• Strong hands-on experience with Databricks, Azure Databricks, Databricks Mosaic AI, PySpark, SQL, Transformation Notebooks, Lakehouse Architecture and Medallion Architecture.
• Proven experience designing and implementing scalable enterprise data platforms and large-scale data pipelines.
• Experience with both batch and real-time/streaming data processing frameworks.
• Strong knowledge of data modeling, ETL/ELT design patterns and cloud-based data storage solutions.
• Experience working with GenAI frameworks and platforms within enterprise environments and governance standards.
• Excellent stakeholder management, requirements gathering and technical leadership skills.
• Strong analytical, problem-solving and communication skills.
• Required certification: Databricks Certified Data Engineer Professional (mandatory).

Nice to have

• Experience in the Energy, Oil & Gas, Utilities or related industry.

Details

• Location: Bangalore RMZ-ECO WORLD, India.
• Worker type: Regular. Start date: October 16, 2026.
• Experience level: Experienced Professionals.
• Flexible working hours and possibility of remote/mobile working.