Data & AI Engineer

Overview

Own the back end of an application end to end, covering design, implementation, testing and troubleshooting of core logic, databases, data pipelines, APIs and CI/CD, with ownership across the full product lifecycle.

What you'll do

• Own the entire back end of the application, including design, implementation, test and troubleshooting of core application logic, databases, data ingestion and transformation, data processing and pipeline orchestration, APIs, CI/CD integration and other processes.
• Fine-tune and optimize queries using the Snowflake platform and database techniques.
• Optimize ETL/data pipelines to balance performance, functionality and other operational requirements.
• Assess and resolve data pipeline issues to ensure performance and timeliness of execution.
• Assist with technical solution discovery to ensure technical feasibility.
• Assist in setting up and managing CI/CD pipelines and developing automated tests.
• Develop and manage microservices using Python.
• Conduct peer reviews for quality, consistency and rigor for production-level solutions.
• Design application architecture for efficient concurrent user handling, ensuring optimal performance during high usage periods.
• Promote best practices and standards for code management, automated testing and deployments.
• Own all areas of the product lifecycle: design, development, test, deployment, operation and support.
• Create detailed documentation on Confluence to support and maintain the codebase and its functionality.

What you'll need

• 4+ years of relevant experience developing backend, integration, data pipelining and infrastructure.
• Bachelor's degree in computer science, engineering, or similar quantitative field of study.
• Expertise in database optimization and performance improvement.
• Expertise in Python, PySpark and Snowpark.
• Experience with data warehouse and object-relational databases (Snowflake and PostgreSQL) and writing efficient SQL queries.
• Experience in cloud-based data platforms (Snowflake, AWS).
• Proficiency in developing robust, reliable APIs using Python and the FastAPI framework.
• Understanding of data structures and algorithms.
• Experience with modern testing frameworks (SonarQube).
• Strong collaboration skills, willingness to work with others to ensure seamless integration of server-side and client-side.

Nice to have

• Experience with K6 testing.
• Knowledge of DevOps best practices and associated tools, especially in the setup, configuration, maintenance and troubleshooting of: containers and containerization technologies (Kubernetes, Argo, Red Hat OpenShift); infrastructure as code (Terraform); monitoring and logging (CloudWatch, Grafana); CI/CD pipelines (JFrog Artifactory); scripting and automation (Python, GitHub, GitHub Actions).

Details

• Location: Hyderabad.