Job Description

Primary Skills

• Test Data Management, Jenkins, Postman, Selenium, BDD - Behavior Driven Development, SoapUI, System Integration testing, Zephyr, TDD - Test Driven Development, Accessibility Testing (JAWS), Cucumber

Job requirements

Experience Range:
With at least 4 years of experience in quality engineering for web applications and microservices, including hands-on testing of AI-enabled applications
 
Key Responsibilities: 
• Design and implement comprehensive test strategies for traditional and AI-powered features within the Personal Health Concierge platform, prioritizing high-impact areas 
• Develop and execute detailed test scenarios based on business requirements and acceptance criteria across provider search, facility search, symptom guidance, benefits navigation, cost estimation, claims status, and contact center handoff modules 
• Perform functional, regression, integration, and system testing to ensure measurable quality and compliance of web applications and microservices 
• Validate chatbot conversations, AI-generated responses, and RAG-based retrieval accuracy, ensuring prompt behavior and guardrail compliance for healthcare-specific use cases 
• Conduct API and integration testing for provider directory APIs, benefits and eligibility APIs, claims APIs, cost estimation services, AI gateway services, and contact center integrations 
• Collaborate with Product Owners, AI Architects, Developers, and Business SMEs to establish robust quality engineering practices and drive continuous improvement 
• Leverage automation tools such as Selenium and Jenkins to streamline testing workflows and increase coverage 
• Perform accessibility testing using JAWS to ensure compliance with accessibility standards across the platform 
Required Skills:
 
1. Jenkins 
2. Postman 
3. Selenium
4. Behavior Driven Development (BDD)
5. SoapUI
6. System Integration Testing
7. Zephyr
8. Test Driven Development (TDD)
9. Accessibility Testing with JAWS
 
Preferred Skills: 
• 1. Cucumber
• 2. AI validation and conversational testing
• 3. Healthcare domain expertise
• 4. Advanced API automation
• 5. Experience with contact center integrations (Avaya)
• 6. RAG (Retrieval-Augmented Generation) testing
•  
Desired Qualifications:
• 1. Bachelor's degree in Computer Science, Information Technology, or a closely related discipline
• 2. Certified Software Quality Engineer (CSQE) or ISTQB Advanced Level Test Analyst certification
• 3. Certification in AI or Machine Learning testing methodologies (preferred for AI-enabled application testing)
Additional Information:
This is a QA Engineer role focused on AI-enabled applications, not a typical QA position.