Senior Data Engineer, BizTech

Overview

Provide technical leadership for BizTech data engineering needs by understanding business requirements, identifying data sources, designing data models, and building reliable, scalable data pipelines for critical business data and products.

What you'll do

• Lead the design, implementation, and testing of data systems, from architecture to production.
• Build batch and real-time data systems that support business needs and critical products.
• Ensure data systems' quality, performance, and stability through rigorous monitoring and quality assurance practices.
• Design and optimize data models to efficiently meet business and product requirements.
• Collaborate with product managers, data scientists, and engineers to develop scalable systems and drive data-driven decisions.
• Maintain partnerships with backend, data science, and machine learning teams to ensure seamless integration of data systems.
• Contribute to long-term data strategies and influence data engineering practices across the organization.
• Mentor and guide team members, fostering best practices for data quality and governance.
• Advance third-party data integrations and enhance frameworks for data exchange, governance, and lineage.

What you'll need

• 9+ years of relevant experience with a Bachelor's/Master’s degree in CS/EE, or 6+ years with a PhD.
• Extensive experience designing, building, and operating distributed data platforms, such as Spark, Kafka, or Flink, at a large scale.
• Proficiency in Java, Scala, or Python.
• Strong skills in data processing and SQL querying.
• A proven track record of designing and optimizing batch and real-time data pipelines.
• Strong collaboration skills with the ability to work with product managers, data scientists, and engineers.
• Advanced problem-solving and analytical skills, with a focus on data quality, governance, and system reliability.
• Excellent written and verbal communication, with the ability to influence stakeholders and convey complex technical concepts.
• Expertise in data modeling, warehousing, and working with relational and columnar databases, such as PostgreSQL, MySQL, Redshift, or BigQuery.
• Strong leadership and mentorship capabilities, with experience guiding teams on best practices and technical strategies.
• Flexibility and innovation, with the ability to adopt new technologies to enhance data systems and processes.

Nice to have

• Experience integrating machine learning models into data systems.

Details

• Location: Bangalore, India.