Overview
Data Engineer I role at Circles in Bangalore, India, working on scalable data platforms and pipelines across multiple markets, with end-to-end ownership of data initiatives and production support.
What you'll do
- Develop and optimize scalable batch and streaming data pipelines using modern data engineering technologies.
- Build and maintain cloud-native data platforms, including data lakes, data warehouses, and real-time data processing systems.
- Take end-to-end ownership of data engineering initiatives, including solution design, development, testing, deployment, performance tuning, monitoring, and production support.
- Collaborate with product, analytics, and engineering teams to understand business requirements and deliver reliable, high-quality data solutions.
- Develop and optimize data models, ETL/ELT pipelines, and data integration frameworks to support business intelligence and operational reporting.
- Deploy and manage data applications on Kubernetes, and implement CI/CD pipelines using GitLab CI/CD.
- Monitor platform health, troubleshoot production issues, perform root cause analysis, and continuously improve system reliability and performance.
- Align with engineering best practices, and contribute to technical documentation and knowledge sharing.
What you'll need
- 1+ years of experience in Data Engineering, or Big Data.
- Strong experience designing and building scalable ETL/ELT pipelines using Python, Spark/PySpark, and SQL.
- Hands-on experience with modern data lakehouse technologies such as Apache Iceberg, Hive, Trino, BigQuery, Redshift, ClickHouse and Snowflake (any one).
- Experience working with cloud object storage solutions such as Amazon S3 or S3-compatible object storage platforms.
- Strong analytical and problem-solving skills with the ability to work independently in a fast-paced environment.
- Excellent communication and stakeholder management skills, with the ability to collaborate effectively across cross-functional teams.
Nice to have
- Experience building and supporting real-time data pipelines using Apache Kafka and distributed data processing frameworks.
- Strong understanding of database technologies, including any one RDBMS like MySQL, Oracle and MongoDB (optional), with expertise in SQL performance tuning and data optimization.
- Experience developing data ingestion frameworks and integrating data from relational and NoSQL (optional) databases using SQLAlchemy, PyMongo, and other database connectivity frameworks.
- Experience deploying and managing applications on Kubernetes, with working knowledge of Docker and GitLab CI/CD pipelines.
- LLM based application using LangGraph, MLOps.
- Experience monitoring, troubleshooting, and optimizing production data platforms, including root cause analysis and performance optimization.
- Good understanding of distributed systems, data architecture, data governance, and security best practices.
- Experience in the telecommunications domain and supporting multi-market data platforms.
- Familiarity with Agile development methodologies and tools such as JIRA.
- Data Platform development, with a strong track record of delivering enterprise-scale data solutions.
Details
- Location: Bangalore, India.
- Reports to a Senior Data Engineering lead.
Read the full description and apply on the company’s own careers page.