Sr. Data Engineer

Overview

The Sr. Data Engineer collaborates with product teams, business partners, cybersecurity and other stakeholders to identify requirements for data-driven features and products. The role designs, implements, tests, monitors and supports data products and pipeline components while addressing data security, privacy, retention, governance and performance requirements.

What you'll do

• Collaborate proactively with stakeholders to clarify requirements and identify key product stakeholders.
• Review technical requirements, escalate potential design issues, and create component designs and documentation.
• Implement code, apply coding patterns and best practices, and adhere to security requirements.
• Participate in code reviews, apply feedback, and take ownership of data products or pipeline components.
• Conduct unit testing, coding standards, and security scans; participate in user acceptance testing.
• Build tools and simple automation processes for transforming, managing, accessing, deploying, and monitoring data processes.
• Create queries to extract and compile raw data, implement orchestration techniques, and validate data quality.
• Ensure adherence to data management principles, governance, and performance monitoring protocols.
• Contribute to troubleshooting guidance and procedures for reviewing and fixing problems flagged by testing.
• Address routine client requests requiring technical knowledge and support software upgrades and server patches for security remediation.
• Independently understand the data ecosystem, security, privacy, and retention requirements necessary to support business and product features.
• Create and document technical designs for components, identify systems, architectures, tools, and storage needs, and present technical solutions to peers.
• Stay current with market trends and industry dynamics, applying this knowledge to drive innovation and ensure the safety and security of product components.
• Work with emerging technologies such as Generative AI tools, including ChatGPT and Microsoft Copilot, to support everyday work.

What you'll need

• 2+ years of relevant work experience and a Bachelor's degree, or 5+ years of relevant work experience.
• Experience in collaborating with cross-functional teams to clarify requirements and define technical solutions.
• Experience in designing and documenting technical components for data products or pipelines.
• Experience in implementing code and applying coding standards and security requirements.
• Experience in conducting unit testing and participating in user acceptance testing.
• Experience in building automation tools for data processes.
• Experience in creating queries and implementing data extraction and transformation techniques.
• Experience in ensuring data quality and performance monitoring.
• Experience in troubleshooting and resolving pipeline issues.
• Experience in supporting software upgrades and security remediation.

Nice to have

• 3 or more years of work experience with a Bachelor’s Degree or more than 2 years of work experience with an Advanced Degree (e.g. Masters, MBA, JD, MD).
• Experience in presenting technical solutions and capabilities to peers.
• Experience in staying current with market trends and applying industry knowledge to innovation.
• Experience in participating in code reviews and mentoring peers.
• Experience in addressing client requests requiring technical knowledge.

Details

• Location: Bengaluru, India.