Solution Architect- Data and AI

Overview

Solution Architect for Data and AI, responsible for architectural decisions and end-to-end design of data and AI solutions.

What you'll do

• Own ADRs, reference blueprints, and target-state designs.
• Architect end-to-end data and AI solutions including medallion Lakehouse and streaming ingestion.
• Optimize large-scale PySpark/Databricks workloads (partitioning, AQE, skew handling, Photon, cluster tuning).
• Design data models across PostgreSQL and Snowflake using patterns like Kimball and Data Vault 2.0.
• Productionize ML/DL models on Azure ML and expose FastAPI endpoints for batch and real-time inference.
• Enforce security and compliance using Entra ID, Key Vault, PII controls, Unity Catalog/ Purview, and GDPR.

What you'll need

• Experience 10–15 years in data architecture, data engineering, or data science.
• Advanced Python, PySpark, SQL, and Databricks with Delta Lake.
• Strong Azure stack including ADLS Gen2, ADF, Synapse, Azure ML, AKS, Event Hubs, and Key Vault.
• Proven medallion Lakehouse architecture experience at TB–PB scale.
• CI/CD and MLOps using Azure DevOps or GitHub Actions plus Terraform/Bicep, Docker, and Kubernetes.
• Hands-on PII/GDPR data handling and cloud security.

Nice to have

• Azure OpenAI, AI Search, RAG, and vector databases.
• IoT ingestion patterns.
• Data Mesh/federated governance experience.

Details

• Location: Pune.