Research Associate in AI Peer Review: Developing and Validating Composite Research Quality Indicators

Role

Title:

Research Associate - Trustworthy AI for Peer Review:
Developing and Validating Composite Research Quality Indicators

Grade and Salary: Grade 7, £37,694 - £47,389 per annum (pro-rata)

FTE and working pattern: Part-Time (0.133

FTE) (5hrs per week) Fixed Term (12 Months)

Reward and Benefits: 33 days annual leave, plus 9 buildings closed days for all full time staff. Use our total rewards calculator:  to see the value of benefits provided by Heriot-Watt University.

We are recruiting a part time research associate to contribute to the UKRI funded project named “Trustworthy AI for Peer Review:
Developing and Validating Composite Research Quality Indicators”.

The overall project will develop, validate, and critique a new generation of scientometric indicators that make the reliability of AI-augmented research assessment visible — so that humans can decide when, why, and how to trust them. We address trustworthiness at two levels. At the process level, we will develop a Trust Card framework that documents how each indicator is constructed, what data it depends on, where it is valid, and where it should not be used.

At the decision level, we will produce indicators accompanied by calibrated estimates of uncertainty, disagreement, and bias, using a combination of statistical, symbolic, and machine-learning techniques designed to make limitations visible rather than hidden.

The successful candidate will support the other two part time research associates, who will work on conceptualisation, development, and implementation of the Trust Card Framework. More specifically, the postholder will work on data processing and analysis, as well as the systematic testing and validation of the Trust Card framework. The postholder will also contribute to the evaluation of the novel scientometric indicators.

• Conduct and disseminate original research aligned with the project and in collaboration with the team
• Responsible for data processing and analysis of  and data from the publisher , as well as systematic testing and validation of the Trust Card by working closely with team members and project partners
• Contribute to the evaluation of novel scientometric indicators
• Work as part of the team to help organize events and support the work of the team as needed
• Contribute to outreach and impact engagement activities of the project.
• Identify appropriate sources of funding and help prepare research proposals for funding bodies
• Demonstrate initiative in making routine decisions in order to manage and achieve project deliverables and deadlines
• Participate in, and develop, networks and collaborations both internally and externally to the Division/School /University
• Any other duties, commensurate with the grade of the post

These are the criteria on which the short-listing and recruitment selection will be made.