Manager Software Engineer

Overview

Lead a team of engineers building Caterpillar's next-generation Digital Manufacturing Data Platform, a central part of the Future of Manufacturing initiative that unifies data across design, engineering, production and supply chain operations.

What you'll do

• Lead, mentor and manage a team of data engineers and platform developers.
• Foster a culture of technical excellence, collaboration and continuous learning.
• Drive Agile practices and ensure timely delivery of high-quality solutions.
• Architect and oversee the development of scalable, secure and resilient data platforms.
• Design and implement near real-time data movement and streaming architectures using tools like Kafka, Spark and cloud-native services.
• Establish best practices in data modelling, ETL/ELT, data governance and metadata management.
• Lead the development of robust data pipelines for ingestion, transformation and delivery using Snowflake and cloud-native tools.
• Optimize data storage, retrieval and processing for performance, reliability and cost-efficiency.
• Implement data quality frameworks, lineage tracking and schema evolution strategies.
• Build and maintain large-scale data lakes and data warehouses for structured and unstructured data.
• Design scalable data architectures to support manufacturing analytics, predictive maintenance and supply chain optimization.
• Leverage AWS and Azure services for data ingestion, transformation and analytics.
• Deploy software using CI/CD tools (git, Jenkins, AWS CloudFormation).
• Ensure platform scalability, security and operational readiness across global deployments.
• Collaborate with Data Science and AI teams to operationalize ML models and analytics workflows.
• Promote integration of AI capabilities into data engineering pipelines (e.g., GenAI, MCP, ATA).
• Support real-time analytics and edge AI use cases in manufacturing environments.
• Partner with product managers, manufacturing SMEs and business leaders to understand requirements and deliver impactful data solutions.
• Communicate technical concepts to non-technical audiences and influence strategic decisions.

What you'll need

• Proven experience in Big Data processing and Data Warehousing.
• Expertise in building end-to-end near real-time data pipelines for OLTP and OLAP.
• Strong architecture exposure for building robust, scalable data platforms.
• Deep expertise in Snowflake, SQL, NoSQL and distributed data systems.
• Strong analytical skills and solid knowledge of computer science fundamentals.
• Deep exposure to AWS and Azure cloud platforms.
• Good understanding of AI concepts and latest developments (Gen AI, MCP, ATA, etc.).
• Bachelor's or Master's degree in Computer Science, Engineering or related field.
• 15+ years of experience in data engineering, with at least 5+ years in a leadership role.
• Demonstrated success in managing engineering teams and delivering complex data solutions.
• Excellent communication, leadership and stakeholder management skills.

Nice to have

• Knowledge of the NVIDIA ecosystem and its applications in data and AI.
• Experience building production-ready AI solutions and integrating with MLOps workflows.
• Familiarity with modern data visualization and BI tools (e.g., Power BI, Tableau, Looker).

Details

• Location: Chennai, Tamil Nadu.
• Works onsite five days a week.
• Visa sponsorship is not available for this position.