Zenitech

Senior QA Automation Engineer (with AI)

Zenitech  •  România (Hybrid)  •  2 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.
74
AI Success™

Job Description

About us

Zenitech is a leading technology solutions provider dedicated to reshaping the global digital landscape. Headquartered in the UK, Zenitech operates internationally, with offices in Lithuania, Romania, and Hungary.

We use a bespoke approach depending on where the client is on their digital journey, comprising a combination of access to dedicated R&D labs, technology implementation advice, and specialist near-shore development talent. As an international community of individuals who are open to learning from each other, we collectively define and contribute to the digital future of our clients’ businesses.

About the role

Our client is a U.S.-based company specializing in healthcare navigation and care coordination. Founded in 1999 they offer services that assist employees of self-funded employers in managing the complexities of healthcare. Their model emphasizes early intervention in an employee's healthcare journey, aiming to improve outcomes and reduce costs for employers

What you will do

  • Own testing strategy and testing solutions, design a multi-layer AI test pyramid. Creating living test standards, not static documents.

  • Ensure regression testing for non-deterministic outputs

  • Ensure variety of tests:

    • Unit tests (prompt + function)

    • Integration tests (agents, tools, APIs)

    • End-to-end conversational tests

    • Chaos / failure injection tests

  • Define AI-specific performance standards

  • Develop performance tests for:

    • Concurrent chat sessions

    • Agent orchestration

    • Long-running workflows

  • While testing track:

    • Latency (p50 / p95 / p99)

    • Token usage & cost behavior

    • Throughput under load

    • Degraded performance modes

Requirements

  • Solid experience in Python

  • Proven experience in developing test automation frameworks (PyTest, Playwright, Cypress, or similar)

  • CI/CD integration (GitHub Actions, GitLab CI, Jenkins)

  • API testing (REST, GraphQL, async workflows)

  • Infrastructure-aware testing (cloud services, queues, event-driven systems)

  • Knowledge in AI driven software testing, such as: LLMs, chatbots

  • AI specific software testing techniques: Prompt variability testing, hallucination detection strategies, bias and drift awareness, golden datasets and snapshot testing

What we offer

  • Hybrid/flexible working model and flexible working hours

  • Private Medical and/or Health Insurance (location dependent)

  • Length of Service Awards

  • Referral programme

  • The option of a cafeteria package, meal tickets, or team lunches (location dependent)

  • A culture of continuous growth, supported by our People Lead system and various training resources for your personal development

  • Agile mindset, simplified processes, and a great atmosphere where commitment and autonomy are celebrated

  • A community-first mindset, working with talented people across technology products and consulting

  • Charity events and programs

Additional benefits based on location:

Hungary:

Extensive cafeteria package tailored to your needs (including SZÉP card)

Romania

Bookster library subscription, and the opportunity to work from abroad (max. 60 days per annum)

(*) As we hire permanent employees for this role, we offer remote opportunities only in Romania and Hungary.

Why Zenitech?

  • Impactful Projects Drive meaningful change through digital transformation projects and have an opportunity to make an impact on many different industries.

  • Collaborative Culture Be part of a diverse, inclusive team committed to growth, innovation, and continuous learning.

  • Professional Growth Zenitech supports continuous learning and development through the People Lead system, helping you advance your skills and career.

Diversity and Inclusion

Zenitech celebrates diversity in all its forms. We aim to create an inclusive environment where everyone feels valued for their unique contributions and perspectives. If you require any adjustments during the application process, please let us know—we’re here to help. Our commitment to diversity, equity, inclusion, and belonging can be found here

Zenitech

About Zenitech

Zenitech creates technology to transform businesses. We design, deliver and implement creative technology that has a real impact on business - creating new revenues, transforming customer experience and interaction, driving growth, reducing time to market and innovating for the future.

How do we do this? Partnership is at the heart of what we do. We - our brilliant teams of designers, engineers, analysts and project managers - treat our clients’ business as if it were our own.

In the words of one of our clients - “Zenitechers exhibit different ways of thinking about the problem, rather than being stuck on ‘this is how we have always done it’. I like the way the engineers offer their own opinions”.

We’ve recently been shortlisted for Services Company of the Year at the 2024 UK IT Industry Awards. Recognition of our impressive track record of delivering high-profile projects with measurable outcomes. This includes building new national Lottery applications to digitalising customer services for a top-tier Hungarian bank.

To learn more visit zenitech.co.uk and to join us, visit zenitech.co.uk/careers

Industry
IT & Software
Company Size
501-1,000 employees
Headquarters
London, GB
Year Founded
2015
Social Media