Caterpillar Inc. logo

Data Engineer(Data Scientist )

Caterpillar Inc.
Posted this week

LOCATION

Chennai · Onsite

EXPERIENCE

Not specified

TYPE

FullTime

SKILLS REQUIRED

PythonData EngineeringData ModelingCI/CDMachine LearningAWS S3Data WarehousingAPI Integration

Job description

Overview

Join the Global Parts Pricing Data Engineering team as a Data Engineer (Data Scientist) supporting pricing analytics and enterprise strategy. Design and deliver scalable data platforms, pipelines, cloud solutions and data products that support pricing decisions, analytics, automation and AI-enabled outcomes.

What you'll do

  • Build infrastructure for extracting, transforming and loading data from a wide variety of data sources.
  • Identify, design and implement internal process improvements by automating manual processes, optimizing data delivery and redesigning infrastructure for greater scalability.
  • Perform debugging, troubleshooting, modifications and testing of integration solutions.
  • Operationalize developed jobs, processes and models.
  • Create databases and infrastructure to process data at scale.
  • Create solutions and methods to monitor systems and solutions.
  • Automate code testing and pipelines.
  • Engage with business partners to participate in the design and development of data integration and transformation solutions according to functional requirements.
  • Design, build and optimize scalable batch and real-time data pipelines for analytics, reporting and AI applications.
  • Develop resilient, scalable and secure solutions using cloud-based data platforms, storage and processing technologies.
  • Consolidate diverse data sources into well-governed, consumable data products using data modeling, transformation and integration techniques.
  • Implement data quality frameworks, monitoring, testing and automated validation.
  • Partner with cross-functional teams to understand business needs and deliver data solutions that support pricing decisions, analytics, automation and AI-enabled outcomes.
  • Engage in continuous learning and actively seek industry perspectives through peer groups and related activities.

What you'll need

  • Ability to design, build and optimize scalable batch and real-time data pipelines.
  • Experience with cloud-based data platforms, storage and processing technologies.
  • Knowledge of data modeling, transformation and integration techniques.
  • Experience implementing data quality frameworks, monitoring, testing and automated validation.
  • Ability to partner with cross-functional teams to understand business needs and deliver data solutions.
  • Extensive experience designing and developing software applications in Python.
  • Experience with AI-assisted software development, such as GitHub Copilot, Cursor or Codex.
  • Extensive experience working with Git version control.
  • Extensive experience deploying software using CI/CD tools such as GitHub Actions or Azure DevOps.
  • Experience with AWS components such as Bedrock, Lambda, Fargate, S3, SageMaker, IAM and RDS.
  • Experience with databases such as PostgreSQL, Snowflake or Oracle.
  • Demonstrated strong learning ability and a proactive approach to staying current with the latest technologies and industry trends.
  • Knowledge of business statistics, including statistical tools, processes and practices used to describe business results and support business decisions.
  • Understanding of accuracy and attention to detail, including completing tasks with high levels of precision.
  • Knowledge of analytical thinking techniques and tools used to determine root causes and create alternative solutions.
  • Knowledge of machine learning principles, technologies and algorithms, with ability to develop, implement and deliver related systems, products and services.
  • Knowledge of programming concepts and capabilities, with ability to use tools, techniques and platforms to write and modify programming languages.
  • Knowledge of data management systems and ability to use, support and access facilities for searching, extracting and formatting data.
  • Knowledge of requirements analysis tools, methods and techniques, with ability to elicit, analyze and record functional and non-functional requirements.

Details

  • Location: Brigade World Trade Center Office, Chennai, India.
  • Work onsite in the office five days a week.
  • Work a five-day-a-week schedule.
  • Work the EMEA shift from 01:00 PM to 10:00 PM IST.
  • Visa sponsorship is not available for this position.

Read the full description and apply on the company’s own careers page.

Stay safe

Hiring on Abekus is free for applicants

We never charge a fee, and employers are prohibited from doing so. If a recruiter asks for payment, please report them right away.

Data Engineer(Data Scientist )