Purpose of the role
To design, develop and improve software, utilising various engineering methodologies, that provides business, platform, and technology capabilities for our customers and colleagues.
Accountabilities
Assistant Vice President Expectations
All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.
Join Barclays as a Artificial Intelligence- QA. You will be involved in designing, developing, and executing testing strategies to validate functionality, performance, and user experience, while collaborating with cross-functional teams to identify and resolve defects, and continuously improve testing processes and methodologies, to ensure software quality and reliability.
To be successful in this role you should have:
Understanding of Large Language Models (LLM), LangChain, and LangGraph frameworks.
Python programming skills with demonstrated ability to architect scalable test automation solutions.
Deep hands-on experience with Generative AI and Agentic AI implementations in production environments.
Machine Learning model testing and validation methodologies
Natural Language Understanding (NLU) testing strategies
Natural Language Processing (NLP) quality assurance
Knowledge of prompt engineering and LLM evaluation frameworks (RAGAS, DeepEval, etc.)
Familiarity with vector databases for RAG testing
Experience with performance and load testing of Gen AI applications
Understanding of AI ethics, bias detection and responsible AI testing practices
Comprehensive knowledge of AWS services, particularly Bedrock, Lambda and CloudWatch.
Experience architecting and implementing enterprise-scale cloud-based testing solutions.
Expert proficiency with version control systems (Git, Stash) and branching strategies.
Proven experience designing and optimizing CI/CD pipelines using Jenkins, GitLab CI, or similar tools.
Deep understanding of Agile/Scrum methodology, SDLC best practices, and DevOps culture.
Demonstrated ability to drive quality initiatives and establish testing excellence across organizations.
Proven expertise in leading cross-functional collaboration with development, product, and operations teams..
Experience establishing quality gates and governance frameworks for Gen AI applications.
Knowledge in UI, mobile and API testing methodologies
Advanced proficiency with Behavior-Driven Development (BDD) frameworks and test design patterns.
Experience with test management and reporting tools including Jira, Xray, ALM, and TestRail.
Some other highly valued skills include:
Experience with containerization (Docker, Kubernetes) for test environments.
Background in data engineering or data quality testing.
Publications, conference presentations, or contributions to open-source testing frameworks.
You may be assessed on the key critical skills relevant for success in role, such as risk and controls, change and transformation, business acumen, strategic thinking and digital and technology, as well as job-specific technical skills.
The successful candidate will be based in Pune.

Barclays is a British universal bank. Our vision is to be the UK-centred leader in global finance. We are a diversified bank with comprehensive UK consumer, corporate and wealth and private banking franchises, a leading investment bank and a strong, specialist US consumer bank. Through these five divisions, we are working together for a better financial future for our customers, clients and communities.
With over 325 years of history and expertise in banking, Barclays operates in over 40 countries and employs approximately 83,500 people. Barclays moves, lends, invests and protects money for customers and clients worldwide.
Barclays is a trading name of Barclays Bank PLC and its subsidiaries. Barclays Bank PLC is registered in England and is authorised by the Prudential Regulation Authority and regulated by the Financial Conduct Authority and the Prudential Regulation Authority. Registered in England. Registered No. 1026167. Registered office: 1 Churchill Place, London E14 5HP.