Imperial College London
Portrait Picture

Dr James Kinross

Faculty of Medicine, Department of Surgery & Cancer

Reader in General Surgery
 
 
 
//

Contact

 

+44 (0)20 3312 1947j.kinross

 
 
//

Location

 

1029Queen Elizabeth the Queen Mother Wing (QEQM)St Mary's Campus

//

Summary

 

Publications

Citation

BibTex format

@article{Minty:2022:10.1186/s12909-022-03701-3,
author = {Minty, I and Lawson, J and Guha, P and Luo, X and Malik, R and Cerneviciute, R and Kinross, J and Martin, G},
doi = {10.1186/s12909-022-03701-3},
journal = {BMC Medical Education},
title = {The use of mixed reality technology for the objective assessment of clinical skills: a validation study},
url = {http://dx.doi.org/10.1186/s12909-022-03701-3},
volume = {22},
year = {2022}
}
Download

RIS format (EndNote, RefMan)

TY  - JOUR
AB  - BackgroundMixed Reality technology may provide many advantages over traditional teaching methods. Despite its potential, the technology has yet to be used for the formal assessment of clinical competency.  This study sought to collect validity evidence and assess the feasibility of using the HoloLens 2 mixed reality headset for the conduct and augmentation of Objective Structured Clinical Examinations (OSCEs).MethodsA prospective cohort study was conducted to compare the assessment of undergraduate medical students undertaking OSCEs via HoloLens 2 live (HLL) and recorded (HLR), and gold-standard in-person (IP) methods. An augmented mixed reality scenario was also assessed.Results13 undergraduate participants completed a total of 65 OSCE stations. Overall inter-modality correlation was 0.81 (p=0.01), 0.98 (p=0.01) and 0.82 (p=0.01) for IP vs. HLL, HLL vs. HLR and IP vs. HLR respectively. Skill based correlations for IP vs. HLR were assessed for history taking (0.82, p=0.01), clinical examination (0.81, p=0.01), procedural (0.88, p=0.01) and clinical skills (0.92, p=0.01), and assessment of a virtual mixed reality patient (0.74, p=0.01). The HoloLens device was deemed to be usable and practical (Standard Usability Scale (SUS) score = 51.5), and the technology was thought to deliver greater flexibility and convenience, and have the potential to expand and enhance assessment opportunities. ConclusionsHoloLens 2 is comparable to traditional in-person examination of undergraduate medical students for both live and recorded assessments, and therefore is a valid and robust method for objectively assessing performance. The technology is in its infancy, and users need to develop confidence in its usability and reliability as an assessment tool. However, the potential to integrate additional functionality including holographic content, automated tracking and data analysis, and to facilitate remote assessment may allow the technology to enhance, expand and standardise examinati
AU  - Minty,I
AU  - Lawson,J
AU  - Guha,P
AU  - Luo,X
AU  - Malik,R
AU  - Cerneviciute,R
AU  - Kinross,J
AU  - Martin,G
DO  - 10.1186/s12909-022-03701-3
PY  - 2022///
SN  - 1472-6920
TI  - The use of mixed reality technology for the objective assessment of clinical skills: a validation study
T2  - BMC Medical Education
UR  - http://dx.doi.org/10.1186/s12909-022-03701-3
UR  - http://hdl.handle.net/10044/1/99081
VL  - 22
ER  -
Download