Senior Data Engineer

Overview

Senior Data Engineers build, maintain and test software architecture and infrastructure for managing data applications. They develop core capabilities for technical and functional data platforms, anchor functional streams of work and are accountable for timely delivery.

What you'll do

• Develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
• Develop intricate data processing pipelines addressing clients' most challenging problems.
• Collaborate with data scientists to design scalable implementations of their models.
• Write clean, iterative code using TDD.
• Leverage continuous delivery practices to deploy, support and operate data pipelines.
• Use distributed storage and computing technologies.
• Develop data models by selecting modeling techniques and implementing the chosen data model using the appropriate technology stack.
• Collaborate with the team on data governance, data security and data privacy.
• Incorporate data quality into day-to-day work.

What you'll need

• 5+ years of experience in Data engineering.
• Pyspark with GCP and AWS, Snowflake and Data bricks are required skills.
• Ability to build and operate data pipelines and maintain data storage within distributed systems.
• Hands-on experience of data modeling and modern data engineering tools and platforms.
• Experience writing clean, high-quality code using the preferred programming language.
• Experience building and deploying large-scale data pipelines and data-centric applications using any of the distributed storage platforms and distributed processing platforms in a production setting.
• Experience with data visualization techniques and the ability to communicate insights as per the audience.
• Experience with data-driven approaches and the ability to apply data security and privacy strategy to solve business problems.
• Experience with different types of databases, including SQL, NoSQL, data lake and data schemas.
• Understanding of stakeholder management and the ability to liaise between clients and other key stakeholders throughout projects, ensuring buy-in and gaining trust.
• Resilience in ambiguous situations and the ability to adapt your role to approach challenges from multiple perspectives.
• Ability to take on and skillfully manage risks or conflicts.
• Eagerness to coach, mentor and motivate others, and aspiration to influence teammates to take positive action and accountability for their work.
• Enjoyment of influencing others and advocacy for technical excellence while being open to change when needed.

Details

• Location: Bangalore, India.