Sr. Associate - Data Engineer

Overview

Revantage is seeking an experienced Data Engineer to design, develop, implement and support core systems that enable the acquisition, curation, modeling and consumption of data for data integration, analytics and data science.

What you'll do

• Develop high-quality code for the core data stack including data integration, data warehousing, data analytics and reporting.
• Design and implement data models and architectures to support analytics and reporting needs.
• Develop and optimize robust Extract, Transform, Load (ETL) processes for the efficient acquisition, transformation and integration of data from various sources.
• Build data pipelines using both batch and streaming paradigms.
• Implement data quality and governance processes to ensure accuracy, consistency and security.
• Work closely with teams and stakeholders to understand requirements and deliver solutions.
• Ensure code, configuration and other technology artifacts are delivered in a timely manner.
• Monitor and troubleshoot data workflows to ensure optimal performance and reliability.
• Maintain comprehensive documentation of data processes, architectures and workflows.

What you'll need

• 7+ years professional experience as a data engineer, with at least 4 utilizing cloud technologies.
• Proven experience working with Databricks either in Azure or AWS.
• Strong experience with the Microsoft Azure Data Stack (Databricks, Data Lake Gen2, ADF etc.).
• Expertise building ETL and data pipelines on Databricks using data engineering languages Python and SQL on Azure.
• Strong SQL skills and proficiency in programming languages such as Python, Scala, Java.
• Familiarity with big data technologies such as Hadoop, Spark or Kafka.
• Proven experience with unit testing and applying appropriate testing methodologies.
• Demonstrable experience with CICD, including release and test automation tools and processes.
• Strong understanding of data modeling, data warehousing and OLAP concepts.
• Excellent technical documentation skills.
• High level of attention to detail, ensuring accuracy and quality in all work outputs.
• Strong analytical and problem-solving skills with the ability to think critically and troubleshoot complex issues.
• Excellent verbal and written communication skills, capable of conveying technical concepts to non-technical stakeholders.
• Ability to adapt to rapidly changing environments and learn new technologies quickly.
• Commitment to delivering high-quality solutions that meet customer needs and expectations.
• Strong organizational skills with the ability to manage multiple priorities and projects simultaneously.
• Bachelor's degree in computer science or equivalent work experience.

Nice to have

• Experience with data visualization tools such as Tableau, Power BI or Looker.
• Experience in event driven architectures (with Snowflake or other analytics platforms).
• Knowledge of full stack technology concepts from hardware, software platforms to UI layers.
• Strong experience with Object oriented design and modelling.
• Experience with visual modelling tools including UML.
• Experience with appropriate organization complexity.
• Experience in Real Estate.
• Relevant industry certifications such as Microsoft Certified: Azure Data Engineer Associate, AWS Certified Data Analytics or Google Professional Data Engineer.
• Demonstrated commitment to continuous learning and professional development through courses, workshops or online platforms such as Coursera, Udemy or Learning.

Details

• Location: Bengaluru.