AI Solution Architect

Overview

Design and help implement end-to-end Generative AI and non-Generative AI applications, with a particular focus on agentic systems. Serve as a hands-on full-stack technical anchor responsible for architecture, code review and architecture enforcement across high-velocity agile teams.

What you'll do

• Define and design AI, with a focus on GenAI and agentic systems, and non-AI software system components for modularity, scalability and security.
• Architect enterprise solutions that integrate AI capabilities with backend services, APIs, MCPs, databases and user interfaces.
• Ensure cloud-native practices across AWS and multicloud deployments, including containerization, orchestration and infrastructure as code.
• Evaluate fit-for-purpose technologies and ensure AI applications follow RDT and business-function architectural patterns and standards.
• Define patterns for using LLMs, multimodal models, RAG, agentic systems and emerging AI technologies.
• Design model-serving pipelines that integrate AI capabilities into business workflows.
• Ensure AI applications follow version control, CI/CD, MLOps, automated testing and code quality practices.
• Conduct rigorous code reviews for agent-assisted and human-generated code.
• Architect secure, scalable integrations between AI models, databases and user interfaces.
• Design data pipelines for structured and unstructured data and high-quality AI model inputs.
• Integrate identity management and authentication mechanisms for secure access to AI applications.
• Work hands-on in the code as a partner within solution development teams.
• Define monitoring and logging strategies for AI applications, model performance, API/MCP health and data integrity.
• Implement AI observability practices for application visibility and anomaly identification.
• Design architectures that follow data governance, security, compliance and ethical AI guidelines.
• Work with AI Engineers, Software Engineers, Product Owners and Agile teams to translate business requirements into AI architectures.
• Provide technical leadership in architecture reviews, design discussions and solution validation.
• Consult with stakeholders across the organization to design and implement AI systems that meet Roche architectural standards and AI governance guidelines.

What you'll need

• 7+ years of experience in software architecture and engineering, including at least 3 years in AI-related projects.
• Proven experience designing and deploying large-scale, cloud-based AI and non-AI systems.
• Proven experience leveraging AI coding agents to accelerate full-stack development cycles.
• Architecting production-level AI systems including RAGs, vector databases, MCP, end users, integrations, observability, DevOps, and durable and available system designs.
• Deep understanding of ML algorithms, model training techniques, evaluation metrics, foundational model utilization and integration, and agentic systems design and engineering.
• Expertise in AWS and multicloud services, serverless computing, and cloud services for building AI applications end-to-end.
• Experience with infrastructure as code using Terraform and securely exposing production-level applications over the network.
• Understanding of hardware and software infrastructure needed to support AI workloads.
• Strong architectural knowledge of vector databases such as AWS OpenSearch and Azure AI Search, Snowflake, SQL, NoSQL, event-driven architectures and graph architectures.
• Experience building resilient, highly available and secure IT systems.
• Strong understanding of software solution security and compliance requirements.
• Ability to influence colleagues and non-technical senior stakeholders on designs.
• Advanced proficiency in Python with strong backend development experience and a strong command of modern frontend ecosystems.
• Experience with CI/CD pipelines, DevOps, infrastructure as code and microservices design.
• B.Sc., B.Eng., M.Sc., M.Eng., Ph.D. or equivalent in Computer Science, Software Engineering, Artificial Intelligence or a related field.
• Strong understanding of AI and traditional software engineering principles.
• Experience implementing DevOps and MLOps principles and practices.
• Experience leading technical teams and mentoring engineers.
• Ability to work collaboratively in a fast-paced, dynamic environment.
• Excellent problem-solving and analytical skills; detail-oriented, highly organized and a great communicator.
• Willingness to learn and expand your skill set in a fluid and multidisciplinary environment.
• English communication at C1+ level.

Nice to have

• Familiarity with TypeScript.
• Proven experience working within highly regulated industries.
• Strong analytical skills for complex architectural and engineering challenges, technology integration and process improvement.
• Understanding of how AI can drive business value and achieve strategic objectives.
• Ability to step into a Tech Lead role when necessary.
• Ability to consult with enterprise stakeholders on technological approaches to business problems.
• Familiarity with AI bias, fairness and responsible AI use.

Details

• Location: Hyderabad, India.
• Working hours capture golden-hour overlap with Central European Time, typically through the IST evening.
• Shift: CET time zone.