Imperial College London
Alternate

Professor Karim Meeran

Faculty of Medicine, Department of Metabolism, Digestion and Reproduction

Professor of Endocrinology
 
 
 
//

Contact

 

+44 (0)20 8846 1065k.meeran

 
 
//

Location

 

9E05Charing Cross HospitalCharing Cross Campus

//

Summary

 

Publications

Citation

BibTex format

@article{Sam:2018:10.1111/medu.13504,
author = {Sam, AH and Field, SM and Collares, CF and van, der Vleuten CPM and Wass, VJ and Melville, C and Harris, J and Meeran, K},
doi = {10.1111/medu.13504},
journal = {MEDICAL EDUCATION},
pages = {447--455},
title = {Very-short-answer questions: reliability, discrimination and acceptability},
url = {http://dx.doi.org/10.1111/medu.13504},
volume = {52},
year = {2018}
}
Download

RIS format (EndNote, RefMan)

TY  - JOUR
AB  - ContextSinglebestanswer questions (SBAQs) have been widely used to test knowledge because they are easy to mark and demonstrate high reliability. However, SBAQs have been criticised for being subject to cueing.ObjectivesWe used a novel assessment tool that facilitates efficient marking of openended veryshortanswer questions (VSAQs). We compared VSAQs with SBAQs with regard to reliability, discrimination and student performance, and evaluated the acceptability of VSAQs.MethodsMedical students were randomised to sit a 60question assessment administered in either VSAQ and then SBAQ format (Group 1, n = 155) or the reverse (Group 2, n = 144). The VSAQs were delivered on a tablet; responses were computermarked and subsequently reviewed by two examiners. The standard error of measurement (SEM) across the ability spectrum was estimated using item response theory.ResultsThe review of machinemarked questions took an average of 1 minute, 36 seconds per question for all students. The VSAQs had high reliability (alpha: 0.91), a significantly lower SEM than the SBAQs (p < 0.001) and higher mean item–total point biserial correlations (p < 0.001). The VSAQ scores were significantly lower than the SBAQ scores (p < 0.001). The difference in scores between VSAQs and SBAQs was attenuated in Group 2. Although 80.4% of students found the VSAQs more difficult, 69.2% found them more authentic.ConclusionsThe VSAQ format demonstrated high reliability and discrimination and items were perceived as more authentic. The SBAQ format was associated with significant cueing. The present results suggest the VSAQ format has a higher degree of validity.
AU  - Sam,AH
AU  - Field,SM
AU  - Collares,CF
AU  - van,der Vleuten CPM
AU  - Wass,VJ
AU  - Melville,C
AU  - Harris,J
AU  - Meeran,K
DO  - 10.1111/medu.13504
EP  - 455
PY  - 2018///
SN  - 0308-0110
SP  - 447
TI  - Very-short-answer questions: reliability, discrimination and acceptability
T2  - MEDICAL EDUCATION
UR  - http://dx.doi.org/10.1111/medu.13504
UR  - http://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000428452400013&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=1ba7043ffcc86c417c072aa74d649202
UR  - http://hdl.handle.net/10044/1/58945
VL  - 52
ER  -
Download