Senior Data Engineer

Overview

Senior Data Engineer on Equifax's Entity Resolution/Keying & Linking team within India Data & Analytics, bridging software development and data science to build reliable data pipelines and data prototypes.

What you'll do

• Build and manage reliable data pipelines to aggregate, ingest, and process data from diverse source systems.
• Integrate, cleanse, and structure large datasets for analytical consumption and client solutions, implementing automated checks to troubleshoot data anomalies.
• Apply an understanding of data characteristics to develop tracking processes that support data quality and entity resolution models.
• Leverage and implement Google Cloud Platform (GCP) technologies, keeping up with cloud advancements to propose optimization improvements.
• Implement data management, security, and maintenance best practices directly into pipeline workflows.
• Collaborate actively with regional and global Equifax teams to share insights, standardize workflows, and adopt best practices.

What you'll need

• BS in a STEM major or equivalent discipline (Mathematics, Statistics, or Computer Science preferred).
• 3 to 5 years of hands-on experience in a data engineering or highly quantitative technical role.
• Strong proficiency in Python and SQL, with practical experience writing utility scripts.
• Competent understanding of cloud computing concepts, with practical experience working in Google Cloud Platform (GCP) or a similar cloud environment.
• Experience transforming unstructured/structured data into optimized data models, troubleshooting pipeline bottlenecks, and ensuring data readiness.
• Solid experience with version control (Git) and exposure to CI/CD integration workflows.

Nice to have

• Hands-on experience with Google BigQuery, BigTable, Dataflow, or big data processing frameworks like PySpark/Scala.
• Familiarity with managing modern schemas and file formats such as JSON, AVRO, and PARQUET.
• Exposure to credit/financial data products or prior project/academic experience with Entity Resolution and identity matching concepts.
• Any active cloud certifications (e.g., GCP Associate Cloud Engineer).

Details

• Location: Bangalore, India.
• Work mode: Hybrid.
• Employment type: Full time.