Data engineer 1

Overview

Data and QA Engineer responsible for understanding client technical requirements and designing and building robust data pipelines, while also performing end-to-end testing and verifying processed data in the software product's UI.

What you'll do

• Play a critical role in the design and implementation of data platforms for the AI products.
• Develop productized and parameterized data pipelines that feed AI products leveraging GPUs and CPUs.
• Develop efficient data transformation code in Spark (in Python and Scala) and Dask.
• Develop data validation tests to assess the quality of the data using agentic frameworks incorporating necessary human-in-the-loop processes to continuously validate and ensure automation effectiveness.
• Verify product functionality from both backend and UI against user requirements or specification.
• Verify bug reports provided by customers and work with customers to specify reproduction steps.
• Document defects with clearly described test steps and reproduction steps.
• Conduct performance testing and profiling of the code using a variety of tools and techniques.
• Build data pipeline frameworks to automate high-volume and real-time data delivery for the data hub.
• Operationalize scalable data pipelines to support data science and advanced analytics.
• Optimize customer data science workloads and manage cloud services costs/utilization.

What you'll need

• B.E / B.Tech in Engineering.
• Hands-on QA experience in UI and data automation with agentic AI.
• Experience in data engineering for building ETL pipelines.
• 1+ years' experience with automation skills.
• Strong verbal and written communication skills to interface with clients and internal teams.
• Deep understanding of databases, SQL, cloud technologies, and modern data integration and orchestration tools (such as Azure Data Factory).
• Experience in data and UI testing across software products.
• Python, PySpark, GCP/Azure, DLT, LLM, RAG, Playwright, Selenium, SQL.

Details

• Location: Bengaluru, India.
• Work mode: hybrid work with adaptable hours, Summer Flex Fridays, and Focus Fridays.