We're seeking a Senior AI QA Test Automation Engineer to take a leading technical role in AI quality and test automation. You will work primarily with our AWS Bedrock AgentCore-based CX Agent Suite, a multi-agent customer-support system covering intent routing, FAQs, deposit-status queries, and human handoff. You will design and build the evaluation and QA tooling required to validate AI agents reliably, while also contributing to technical standards and best practices across QA.
This is a Senior Individual Contributor (IC) role with a strong technical and strategic focus. You'll work closely with QA leadership, Data Science, and Engineering to architect scalable AI evaluation systems, establish technical standards, and drive the evolution of our AI evaluation framework. Our current evaluation harness is based on DeepEval and is evolving towards a broader agentic evaluation architecture. You will have the opportunity to evaluate and prototype emerging agent-orchestration approaches, including Strands Agents, and contribute to architectural decisions around their adoption.
All applications will be treated with strict confidentiality!

🏆 At XM, we're not just another forex and CFD broker. Since our inception, we've been on a mission to redefine currency trading. Our dedication to innovation and excellence has earned us numerous awards and made us a prominent leader in the global fintech landscape.
🌎 With a diverse team of over 1,400 professionals spanning seven offices across the globe, we're united by our commitment to providing exceptional service in over 30 languages.
🚀 But what truly sets us apart is our #XMers. We don't just embrace growth, learning, and innovation – we own it. As part of the XM family, we dive headfirst into challenges, supporting each other every step of the way.
🙌 Guided by our values - Big. Fair. Human. - we have cultivated an unparalleled work environment, where every individual is nurtured for both personal and professional growth. Competitive benefits and perks that exceed market average, engaging team activities, rewarding volunteer programs, initiatives supporting the employees’ physical and mental wellbeing, and flexible work arrangements are only some of the proof points of how XM prioritizes its people’s wellbeing and work-life balance. And with a strong focus on learning and development, diversity and inclusion, and fostering a culture where everyone's voice is heard, we empower each member of our team to be a leader in their own right.
🤘 Ready to join a community that rocks and work somewhere truly awesome? ▶ xm.com/careers