Skip to main content

Research Repository

Advanced Search

Evaluating the implementation of online exam proctoring on physiology module attainment and student experience.

Jones, Matthew; Miklavc, Pika

Authors



Abstract

Introduction
Online examination is a widely utilised strategy for higher education assessment due to its numerous benefits for universities, academic staff, and students. Exemplar benefits of online assessment include increased student flexibility to complete the exam and automated marking, decreasing academic workload (Huber et al., 2024). However within the wider sector, online examination has been shown to inflate grades due to students completing exams in groups or as open-book exams, meaning knowledge acquisition is inadequately tested (Newton & Essex, 2023). A phenomenon which became prominent during the rapid shift to online assessment during the COVID-19 pandemic.
To mitigate this, invigilation of online assessments using approaches known as proctoring has been suggested. Proctoring software utilises recording or artificial intelligence-based approaches to monitor student information associated with potential academic misconduct, thus ensuring online examinations are conducted under comparable conditions to in-person examinations (Nigam et al., 2021). With knowledge acquisition one of the key intended learning outcomes of physiology-based modules, developing a detailed understanding of proctored online examinations may benefit students and staff. This study aims to evaluate the impact of implementing online examination proctoring on student academic attainment, experience, and wellbeing.
Methods
Physiology-aligned module grade analysis was conducted using exam board data from 2022/23 (Unproctored) and 2023/24 (Proctored) academic years following ratification by internal and external moderation. The student experience was evaluated by the completion of an anonymous survey following the completion of proctored examinations. All questions used a 5-point Likert scale containing negative, neutral, and positive options. Survey questions related to student experience, academic integrity, and wellbeing. This study was approved by the University of Salford's ethical review board (Ethics ID: 11889).
Results
Evaluation of student attainment following proctoring implementation revealed a leftward shift in grade distributions following the addition of proctoring to online exams. This resulted from average exam grades significantly decreasing from 65.8±12.4% (n=307) to 57.8±15.9% (n=274) following the addition of proctoring (P<0.0001). When compared to students’ coursework grades achieved in the same academic year, the disparity in attainment between assessment styles significantly increased from 7.7±14.5 % to 12.4±18.2 % following the implementation of exam proctoring (n=273-300; P=0.0006). Irrespective of proctoring status, there was a positive correlation between coursework attainment and exam attainment (Unproctored: R=0.33, P<0.0001, n=300; Proctored: R=0.32, P<0.0001, n=270).
A total of 36 students completed the student experience and wellbeing survey following proctored exams. Students stated that they believed proctoring negatively impacted their attainment (41.7% of respondents) but decreased academic misconduct (55.6%) and ensured exam conditions (72.2%). Only a third of respondents had positive experiences using proctoring with 38.9% stating they had a negative experience. Students revealed they were more nervous before proctored exams compared to unproctored ones (77.8%). The majority of students surveyed (72.2%) found proctoring easier and less stressful in any subsequent proctored exams.
Conclusion
These data show that exam proctoring is an effective tool to combat grade inflation whilst simultaneously ensuring academic conduct and rigour in online examinations. However, its implementation may adversely impact student experience, which should be accounted for before its implementation.

Citation

Jones, M., & Miklavc, P. (2024, July). Evaluating the implementation of online exam proctoring on physiology module attainment and student experience. Presented at Physiology in Focus 2024, Northumbria University, Newcastle-upon-Tyne, United Kingdom

Presentation Conference Type Speech
Conference Name Physiology in Focus 2024
Conference Location Northumbria University, Newcastle-upon-Tyne, United Kingdom
Start Date Jul 2, 2024
End Date Jul 4, 2024
Deposit Date Jul 9, 2024
Publisher URL https://www.physoc.org/events/physiology-in-focus-2024/
Related Public URLs https://static.physoc.org/app/uploads/2024/06/24084605/Physiology-in-Focus-2024-Abstracts-Oral-Communications.pdf