1. Home
  2. Guidance
  3. Case Studies
  4. Gen AI Case Studies
  5. Case Study: Gen AI assessment clinic reflection
  6. Case Study: Gen AI assessment clinic reflection

Case Study: Gen AI assessment clinic reflection

Published on: 21/03/2024 · Last updated on: 02/09/2024

Background

A group of people working around a table.
Image by Fauxels from Pexels.com

Earlier this year, to provide clarity to staff and students on the use of Generative AI (GenAI) in assessments, the University of Bath introduced Generative AI – Assessment Categories.

Assessments should be categorised in terms of where the use of GenAI:

Type A: Is not permitted.
Type B: Is permitted as an assistive tool for specific defined processes within the assessment and its use is not mandatory in order to complete the assessment.
Type C: Has an integral role, the use of GenAI is mandatory, and is used as a primary tool throughout the assessment process.

(adapted from guidance produced by UCL)
Assessment categories provided from the Generative AI – Assessment Categorisation article on the Learning and Teaching Hub.

To support staff and provide guidance on how these categories can work with their assessment pieces, the Curriculum and Academic Development (CAD) team from the Centre of Learning and Teaching held a GenAI Assessment clinic with colleagues in the Faculty of Engineering and Design. The objective of the clinic was for staff to have a space to discuss their assessment pieces and evaluate how Gen AI could be incorporated or mitigated in it.

Approach

Teaching colleagues came to the clinic prepared with their assessment pieces, concerns, and ideas they wanted to explore during the session. Breaking into small groups, teaching staff and CAD members were able to address the different needs and challenges presented. Some staff members came with questions about specific areas of concerns in their assessments and some came to get a more top-level understanding of how GenAI could affect their assessments.

A slide from the clinic providing examples of assistive ways Gen AI may potentially be used by their students as well as a link to prompting techniques.
A slide from the clinic providing examples of assistive ways Gen AI may potentially be used by their students as well as a link to prompting techniques.

Overall, in the clinic we were able to share ideas, discuss what some have tried and their findings and plan ways forward. Short- and long-term concepts, such as adding reflective pieces to the assessments and reviewing learning objects were looked at by the group. Participants left with ideas on how to review, reduce or develop their assessment in the challenge of GenAI to make them more robust.

Generative AI and Assessment review model provided from the Generative AI and Assessment article on the Learning and Teaching Hub.
Generative AI and Assessment review model provided from the Generative AI and Assessment article on the Learning and Teaching Hub.

Next Steps

Moving forward, additional clinics for other faculties and schools were deemed valuable with the understanding that continued smaller groups sizes would be beneficial as the range of specific concerns from teaching staff could be addressed.

A challenge to the continued success of the clinic is the need to keep groups sizes small as more support staff would be required if attendance grows, in time, community of practices could supplement the clinics and allow teaching staff to share their ideas with each other and grow from each other’s good practice.

If you have any further questions or think your department would benefit from the Gen AI Assessment clinic, please reach out. Also, if you have any examples of how you or a colleague have incorporated Gen AI into your assessments and feel comfortable sharing your experience with the wider university, please let us know. You can contact Lynn from CAD at lcw56@bath.ac.uk.

Article originally published: 21 March 2024

Was this article helpful?

Related Articles