Data Engineer

Overview

Visa is hiring a Data Engineer for its Data Engineering team (GDO) supporting the Visa Consulting & Analytics line of business in Bengaluru.

What you'll do

• Build and run data pipelines to deliver analytic insights for internal and external clients.
• Create and manage large-scale ETL processes for card-level aggregated attributes.
• Write modular, reusable code that is configurable and scalable while following low-level design.
• Perform unit testing and document test results using standard templates.
• Build, schedule, and manage DAGs in Apache Airflow and monitor pipeline tasks.
• Ensure data quality by reconciling data across pipeline stages.
• Debug execution errors, fixing data issues promptly, and collaborate with stakeholders for clarifications.

What you'll need

• Minimum 6 months work experience or a Bachelor's degree.
• 1–2 years development experience building data pipelines and coding with Hive, PySpark, SQL, Python, and Unix.
• Experience writing and optimizing SQL queries in big data environments (on-prem and cloud such as AWS, GCP, Azure).
• Experience working in Linux/Unix and using command line utilities.
• Experience creating/supporting production systems and resolving performance bottlenecks.
• Strong communication skills.

Details

• Location: Bengaluru, India.
• Work requirement: at least 3 days in office (details to be confirmed by the Hiring Manager).