Data Engineer

Overview

Support the design, implementation, and maintenance of data pipelines and processing jobs to enable secure, scalable, and high-quality technology solutions. Work hands-on with code, data, and modern tools while collaborating with cross-functional teams to translate business requirements into robust technical solutions.

What you'll do

• Attend meetings with stakeholders to learn about requirements and understand data ecosystem, security, privacy, and retention needs.
• Interpret technical requirements and execute component designs provided by senior engineers.
• Create and implement code across assigned components, applying coding patterns, guidelines, and best practices.
• Participate in code review processes, gather feedback, and apply changes to owned aspects of code or design.
• Conduct unit testing and support testing code for one component in a common testing environment.
• Contribute to the development of tools and automation processes for transforming, managing, accessing, deploying, and monitoring data processes.
• Collaborate with team members to create queries, extract and compile raw data, and apply basic modification techniques to transform data.
• Review and escalate alerts to maintain a data pipeline, assist with investigations, and implement basic solutions to minimize failures.
• Follow troubleshooting guidance for reviewing, addressing, and fixing basic problems flagged by testing, and escalate complex issues as needed.
• Adhere to best practices, security standards, and regulatory requirements.
• Contribute to the innovation process by applying knowledge of market trends and industry dynamics.
• Use emerging technologies such as Generative AI tools, including ChatGPT and Microsoft Copilot, to support everyday work.

What you'll need

• Bachelor's degree, or 3+ years of relevant work experience.
• Experience in attending stakeholder meetings to gather requirements.
• Experience in interpreting technical requirements and executing component designs.
• Experience in creating and implementing code across assigned components.
• Experience in participating in code review processes and applying feedback.
• Experience in conducting unit testing and supporting code testing in a common environment.
• Experience in developing tools and automation processes for data management.
• Experience in collaborating with team members to extract, compile, and transform data.
• Experience in reviewing and escalating alerts to maintain data pipelines.
• Experience in troubleshooting and resolving basic issues in data pipelines.

Nice to have

• 2 or more years of work experience.
• Experience with Hadoop, Hive, HBase, Spark, Trino, or comparable distributed data systems.
• Experience with data pipelines, ETL/ELT, data-quality frameworks, Java or Python, SQL, Git, and production troubleshooting.
• Experience in contributing to the innovation process by applying knowledge of market trends and industry dynamics.
• Experience in applying coding patterns, guidelines, and best practices.
• Experience in using tools to investigate vulnerabilities in software code.
• Experience in collaborating with team members to merge data into distributed systems, products, or tools.

Details

• Location: Bengaluru, India.