Job Description

Role Title: Research Associate - Trustworthy AI for Peer Review: Developing and Validating Composite Research Quality Indicators

Grade and Salary: Grade 7, £37,694 - £47,389 per annum (pro-rata)

FTE and working pattern: Part-Time (0.133FTE) (5hrs per week) Fixed Term (12 Months)

Reward and Benefits: 33 days annual leave, plus 9 buildings closed days for all full time staff. Use our total rewards calculator: https://www.hw.ac.uk/about/work/total-rewards-calculator.htm to see the value of benefits provided by Heriot-Watt University.

Purpose of Role

We are recruiting a part time research associate to contribute to the UKRI funded project named “Trustworthy AI for Peer Review: Developing and Validating Composite Research Quality Indicators”.

The overall project will develop, validate, and critique a new generation of scientometric indicators that make the reliability of AI-augmented research assessment visible — so that humans can decide when, why, and how to trust them. We address trustworthiness at two levels. At the process level, we will develop a Trust Card framework that documents how each indicator is constructed, what data it depends on, where it is valid, and where it should not be used. At the decision level, we will produce indicators accompanied by calibrated estimates of uncertainty, disagreement, and bias, using a combination of statistical, symbolic, and machine-learning techniques designed to make limitations visible rather than hidden.

The successful candidate will support the other two part time research associates, who will work on conceptualisation, development, and implementation of the Trust Card Framework. More specifically, the postholder will work on data processing and analysis, as well as the systematic testing and validation of the Trust Card framework. The postholder will also contribute to the evaluation of the novel scientometric indicators.

Key Duties and Responsibilities

• Conduct and disseminate original research aligned with the project and in collaboration with the team
• Responsible for data processing and analysis of REF data and data from the publisher , as well as systematic testing and validation of the Trust Card by working closely with team members and project partners
• Contribute to the evaluation of novel scientometric indicators
• Work as part of the team to help organize events and support the work of the team as needed
• Contribute to outreach and impact engagement activities of the project.
• Identify appropriate sources of funding and help prepare research proposals for funding bodies
• Demonstrate initiative in making routine decisions in order to manage and achieve project deliverables and deadlines
• Participate in, and develop, networks and collaborations both internally and externally to the Division/School /University
• Any other duties, commensurate with the grade of the post

Person Specification

These are the criteria on which the short-listing and recruitment selection will be made.

Essential

1. PhD in Computer Science or a relevant discipline, or currently working towards a PhD in Computer Science or a closely related discipline
2. Experience of data processing and analytics.
3. Experience or desire to work with those from other disciplines
4. Evidence of self-motivation and the ability to work independently
5. Evidence of excellent oral and written communication skills
6. Excellent time management skills including the ability to prioritise workload

Desirable

1. Experience in machine learning research and applications, especially LLM related development and evaluation
2. Experience in using LLMs or agentic systems for processing and evaluating research papers
3. Experience in software testing
4. Knowledge in trustworthy AI
5. Experience in working in interdisciplinary research or industrial projects
6. Evidence or knowledge to support international activities

How to Apply

Please submit via the Heriot-Watt on-line recruitment system (1) Cover letter describing your interest and suitability for the post; (2) Full CV

Applications can be submitted until 23:55 on Tuesday 13th October 2026.

About Heriot-Watt University

At Heriot Watt we are passionate about our values and look to them to connect our people globally and to help us collaborate and celebrate our success through working together. Our research programmes can deliver real world impact which is achieved through the diversity of our international community and the recognition of creative talent that connects our global team.

Our flourishing community will give you the freedom to challenge and to bring your enterprising mind and to help our partners with solutions that can be applied now and in the future. Join us and Heriot Watt will provide you with a platform to thrive and work in a way that also helps you live your life in balance with well-being and inclusiveness at the heart of our global community.

Heriot-Watt University is committed to securing equality of opportunity in employment and to the creation of an environment in which individuals are selected, trained, promoted, appraised and otherwise treated on the sole basis of their relevant merits and abilities. Equality and diversity are all about maximising potential and creating a culture of inclusion for all.

Heriot-Watt University values diversity across our University community and welcomes applications from all sectors of society, particularly from underrepresented groups. For more information, please see our website https://www.hw.ac.uk/uk/services/equality-diversity.htm and also our award-winning work in Disability Inclusive Science Careers https://disc.hw.ac.uk/ .

We welcome and will consider flexible working patterns e.g. part-time working and job share options.

Use our total rewards calculator: https://www.hw.ac.uk/about/work/total-rewards-calculator.htm to see the value of benefits provided by Heriot-Watt University.