Data/AI Engineer (Databricks, AWS, Python, AI)

Overview

Data/AI Engineer to design, develop, enhance, and support scalable cloud-based data pipelines, data products, and data-driven applications.

What you'll do

• Build and optimize data ingestion, transformation, integration, and storage solutions.
• Design, develop, test, and maintain scalable batch and real-time data pipelines and cloud data solutions.
• Own deliverables from design through deployment, ensuring quality, reliability, performance, security, and maintainability.
• Implement data quality controls, monitoring, observability, automation, and CI/CD practices.
• Troubleshoot production issues and perform root-cause analysis with preventive actions.
• Support and enhance business-critical data products and applications through incident resolution and modernization.

What you'll need

• Bachelor’s degree in CS, IT, Engineering, Computer Applications, or a related discipline.
• Minimum 5 years of relevant experience, with most experience in Data Engineering.
• Hands-on experience with scalable data pipelines, ETL/ELT frameworks, and cloud data solutions.
• Experience delivering data engineering solutions in cloud environments and Agile product teams.
• Strong proficiency in Python, PySpark, Pandas, and Advanced SQL.
• Hands-on experience with AWS data services including S3, Glue, Lambda, Redshift, Athena, Step Functions, SNS/SQS, IAM, CloudWatch, and Kinesis.
• Working experience with Redshift, Databricks, and Spark.

Details

• Role based in Hyderabad, Telangana at Vanguard India.
• Hybrid working model mentioned for most employees.