Overview
Data Engineer, Specialist role at Vanguard India in Hyderabad, responsible for building and maintaining scalable data pipelines, ETL processes and database systems that support analytics and business intelligence.
What you'll do
- Design, develop and maintain scalable ETL (Extract, Transform, Load) processes to extract data from structured and unstructured sources, ensuring accuracy, consistency and performance optimization.
- Architect and manage database systems to support large-scale data storage and retrieval, ensuring high availability, security and efficiency in handling complex datasets.
- Integrate and transform data from multiple sources including APIs, on-premises databases and cloud storage, creating unified datasets to support data-driven decision-making.
- Collaborate with business intelligence analysts, data scientists and other stakeholders to understand specific data needs and deliver high-quality, business-relevant datasets.
- Monitor, troubleshoot and optimize data pipelines and workflows to resolve performance bottlenecks, improve processing efficiency and ensure data integrity.
- Develop automation frameworks for data ingestion, transformation and reporting to streamline data operations and reduce manual effort.
- Work with cloud-based data platforms and technologies such as AWS (Redshift, Glue, S3), Google Cloud (BigQuery, Dataflow), or Azure (Synapse, Data Factory) to build scalable data solutions.
- Optimize data storage, indexing and query performance to support real-time analytics and reporting, ensuring cost-effective and high-performing data solutions.
- Lead or contribute to special projects involving data architecture improvements, migration to modern data platforms, or advanced analytics initiatives.
What you'll need
- Minimum 5 years of relevant work experience, with at least 2 years in designing and maintaining data pipelines, ETL processes and database architectures.
- Bachelor's degree (B.E./B.Tech) in Computer Science or IT, or Bachelor's in Data Science, Statistics, or related field.
- Strong expertise in SQL, Python, or Scala for data processing, automation and transformation.
- Hands-on experience with big data frameworks such as Apache Spark, Hadoop, or Kafka for real-time and batch processing.
- Experience in cloud data platforms including AWS Redshift, Google BigQuery, or Azure Synapse, with proficiency in cloud-native ETL and data pipeline tools.
- Strong understanding of data modeling principles, relational and NoSQL databases (PostgreSQL, MySQL, MongoDB, Cassandra).
Details
- Based in Hyderabad, Telangana at Vanguard India.
- Only qualified external applicants will be considered.
- Hybrid working model for most employees.
Read the full description and apply on the company’s own careers page.