Data Engineer II

Overview

Data Engineer II role focused on building and operating scalable, secure cloud data solutions for big data and data lake/data mesh environments.

What you'll do

• Provide technical guidance and support to development teams and clients across the solution lifecycle.
• Troubleshoot and resolve complex issues in cloud-based Data Lake and Data Mesh environments.
• Develop and implement scalable and secure cloud solutions for big data platforms.
• Optimize data pipelines for high-volume/high-velocity data streams using distributed cloud computing.
• Implement mixed batch/near-real-time architectures to analyze, index, and publish data for applications.
• Create and maintain documentation for solution designs and configurations.
• Train and support clients and internal teams on solution architecture.

What you'll need

• 5+ years of experience in database development, MDM, and data integration initiatives.
• 5+ years hands-on designing and implementing ETL/ELT solutions using Azure data integration technologies including Azure Data Factory, Azure Functions, Logic Apps, and Azure Databricks.
• Strong expertise in Azure Databricks and PySpark for scalable, high-performance data pipelines.
• Proficient in SQL development, including writing, optimizing, and troubleshooting complex queries in Azure-based or other relational databases.
• Knowledge of SDLC best practices, source code management, CI/CD processes, and Azure DevOps/GitHub integration.
• Ability to collaborate to implement and promote data management frameworks and governance standards.
• Comfort working in structured, process-driven, and governance-focused organizations.

Details

• Hybrid work mode with location listed as Hyderabad, India.