Software Engineer III - GBS IND

Overview

Software Engineer III on the GenAI & Digital Assets Platform team, contributing to the continued maturity and scale of Orchestra, the enterprise GenAI platform.

What you'll do

• Refine requirements, estimate delivery effort, and contribute to technical solution design.
• Design, develop, test, and maintain scalable capabilities for the Orchestra GenAI platform.
• Build and enhance GenAI solutions, including RAG pipelines, AI agents, prompt workflows, model integration, and safety controls.
• Develop production-ready services using Python, APIs, microservices, containers, and Kubernetes or OpenShift.
• Implement automated testing, continuous integration and deployment, monitoring, and operational controls.
• Improve platform performance, scalability, resiliency, maintainability, and developer experience.
• Conduct technical prototypes to evaluate emerging GenAI technologies and reduce delivery risk.
• Ensure solutions meet security, privacy, compliance, and responsible AI requirements.
• Collaborate with globally distributed business and technology teams.
• Mentor engineers and promote consistent engineering practices.

What you'll need

• Bachelor's or higher degree in Computer Science, Information Technology, Engineering, or a related discipline, or equivalent practical experience.
• 8-10 years of experience.
• Strong software engineering experience, including the design and delivery of enterprise applications or platforms.
• Advanced Python development skills and experience with APIs, microservices, and Unix or Linux environments.
• Hands-on experience building and deploying GenAI or machine-learning solutions in production.
• Experience with LLM frameworks such as Hugging Face Transformers, PyTorch, or TensorFlow.
• Experience developing RAG solutions using embeddings, retrieval techniques, and vector databases.
• Experience with Docker and Kubernetes or OpenShift.
• Understanding of prompt engineering, LLM evaluation, monitoring, guardrails, privacy, and responsible AI controls.
• Experience with relational or NoSQL databases and structured and unstructured data.
• Strong analytical, problem-solving, and stakeholder communication skills.
• Ability to work effectively across globally distributed teams.

Nice to have

• Experience with AI agents, tool integration, and orchestration frameworks such as LangChain.
• Experience with model fine-tuning, model compression, or inference optimization.
• Experience implementing AI solutions in financial services or another regulated environment.
• Knowledge of Global Markets or Sales and Trading.
• Experience establishing automated evaluation, model monitoring, or MLOps capabilities.

Details

• Location: Chennai, Tamil Nadu.
• Work timings: 11:30 AM to 8:30 PM.
• Certifications: NA.
• Bank of America is committed to an in-office culture, with an appropriate level of flexibility based on role-specific responsibilities and business needs.