No Detail Found!

Student Perception and Post-exam Analysis of One Best Mcqs and One Correct Mcqs: a Comparative Study.

Author(s)
Mohammad Idrees Adhi King Abdul Aziz Medical City & King Abdullah Specialized Children Hospital, National Guard Health Affairs, Riyadh, Saudi Arabia
Syed Moyn Aly Department of Medical Education, Jinnah Sindh Medical University, Rafique Shaheed Road, Karachi, Pakistan
Abstract
Objective: To find differences between One-Correct and One-Best multiple-choice questions with relation to student scores, post-exam item analyses results and student perception. Methods: This comparative cross-sectional study was conducted at the Dow University of Health Sciences, Karachi, from November 2010 to April 2011, and comprised medical students. Data was analysed using SPSS 18. Results: Of the 207 participants, 16(7.7%) were boys and 191(92.3%) were girls. The mean score in Paper I was 18.62±4.7, while in Paper II it was 19.58±6.1. One-Best multiple-choice questions performed better than OneCorrect. There was no statistically significant difference in the mean scores of the two papers or in the difficulty indices. Difficulty and discrimination indices correlated well in both papers. Cronbach's alpha of paper I was 0.584 and that of paper II was 0.696. Point-biserial values were better for paper II than for paper I. Most students expressed dissatisfaction with paper II. Conclusion: One-Best multiple-choice questions showed better scores, higher reliability, better item performance and correlation values.
Publication Details
Page(s) 570-575
DOI DOI not available
Published Journal: Journal of Pakistan Medical Association, Volume: 68, Issue: 4, Year: 2018

Request the full text from PASTIC

Keywords
Reliability, Post-exam analysis, Item analysis, : One-Best MCQs, Student perception, One-Correct MCQs, Type A MCQs
References
SwanwickT,Publication,,2010,,Understanding Medical Education: Evidence, Theory and Practice. 1st Edition,,137,140
RotemA,BarrandJ,AzmanA,,1982,Analysis of examinations in curriculum review,Med Educ,16,3,6
DowningSM,DowningSM,YudkowskyR,,2009,Assessment in Health Professions Education,,,107,109
MillerGE,,1990,The assessment of clinical skills/ competence/ performance,Acad Med,65,s63,67
PeitzmanSJ,NiemanLZ,GracelyEJ,,1990,Comparison of "fact recall" with "higher order questions in multiple choice examinations as predictors of clinical performance of medical students,Acad Med,65,S59,60
MitraN K,Nagaraja H S , Ponnudurai G,Judson J P.,,2009,The levels of difficulty and discrimination indices in type - A multiple choice questions of pre-clinical semester 1 multidisciplinary summative tests,Ie JSME,3,2,7
BridgePD,MusialJ,FrankR,RoeT,SawilowskyS.,,2003,Measurement practices: Methods for developing content-valid student examinations,Med Teach,25,414,21
SheaJA,FortnaGS,Van der VleutenCPM,NewbleD,,2002,Psychometric models,International handbook of research in Medical Education,,97,100
TavakolM,DennickR,,2011,Post-examination analysis of objective tests,Med Teach,33,447,58
TweedM,WilkinsonT.,,2009,A randomized controlled trial comparing instructions regarding unsafe response options in a MCQ examination,Med Teach,31,51,4
CarrollRG,,1993,Evaluation of vignette-type examination items for testing medical physiology,Am J Physiol,264,S11,5
NorciniJJ,SwansonDB,GrossoLJ,WebsterGD,,1985,Reliability, validity and efficiency of multiple choice question and patient management problem item formats in assessment of clinical competence,Med Educ,19,238,47
DowningSM,BaranowskiRA,GrossoLJ,,1995,Item type and cognitive ability measured: The validity evidence for multiple true-false items in medical specialty certification,Appl Meas Educ,8,187,97
HingorjoMR,JaleelF.,DistractorEfficiency,,2012,Analysis of One-Best MCQs: the Difficulty Index, Discrimination Index,J Pak Med Assoc,62,142,7
BaigM,AliSK,AliS,HudaN.,,2014,Evaluation of Multiple Choice and Short Essay Question items in Basic Medical Science,Pak J Med Sci,30,3,6
Mahmood H.,,2015,Correlation of MCQ and SEQ Scores in Written Undergraduate Ophthalmology Assessment,J Coll Physicians Surg Pak,25,185,8
AbdulghaniHM,AhmadF,IrshadM,KhalilMS,Al-ShaikhGK,SyedS,,2015,Faculty development programs improve the quality of Multiple Choice Questions items' writing,Sci Rep,5,9556,
KareliaBN,PillaiA,VegadaBN,,2013,The levels of difficulty and discrimination indices and relationship between them in fourresponse type multiple choice questions of pharmacology summative tests of Year II M.B,IeJSME,7,41,6
Taib F, Yusoff MSB. Difficulty index, discrimination index, sensitivity and specificity of long case and multiple choice questions to predict medical students' examination performance. J Taibah Uni Med Sci 2014; 9: 110-4.
AxelsonRD,CreiterCD,DowningSM,YudkowskyR,,2009,Assessment in Health Professions Education,,,62,64
TanLT,McAleerJJA,Oncol (R Coll Radiol,,2008,Final FRCR Examination Board. The Introduction of Single Best Answer Questions as a Test of Knowledge in the Final Examination for the Fellowship of the Royal College of Radiologists in Clinical Oncology,,20,571,6
SimSM,RasiahRI,,2006,Relationship between item difficulty and discrimination indices in true/false - type multiple choice questions of a para-clinical multidisciplinary paper,Ann Acad Med Singapore,35,67,71
Dolmans DHJM, Wolfhagen IHAP, Heineman E, Scherpbier AJJA. Factors Adversely Affecting Student Learning in the Clinical Learning Environment: A Student Perspective. Educ Health (Abingdon) 2008; 21: 32.
0

Citations

0

Downloads

100

Views