The Effect on Student Performance of Scrambling Questions and Their Stems in Medical Colleges Admission Tests | [Journal of College of Physicians and Surgeons--Pakistan : JCPSP • 2013]

Author(s):

1. Junaid Sarfraz Khan: University of Health Sciences, Khayaban-e- Jamia, Punjab, Lahore., Pakistan.

2. Saima Tabasum: Department of Examinations, University of Health Sciences,Lahore, Pakistan.

3. Osama Mukhtar: Department of Examinations, University of Health Sciences,Lahore, Pakistan.

4. Maryam Iqbal: Department of Examinations, University of Health Sciences,Lahore, Pakistan.

Abstract:

Assessment is an indispensable part of an educational program. Multiple Choice Questions (MCQs) is an objective tool of assessment provided cheating is controlled. A method employed to reduce the chance of cheating is to scramble the sequence of the MCQs and responses in multiple papers having the same content. It is assumed that the performance of students is mainly dependent on the difficulty of the items and not the order in which they are placed within the instrument. The marks obtained by 1,02,211 candidates sitting in Medical Colleges Admission Test (MCAT) from 2008 to 2011 and given similar-content but scrambled-sequence question paper codes were analyzed using parametric tests. A significant difference amongst the mean marks of candidates in the different codes of MCAT 2008 (F = 22.15, p < 0.001) and MCAT 2011 (F = 3.85, p = 0.009) was identified. No significant difference was found in the mean marks of the candidates' each year for different codes in each centre.

Page(s): 904-906

DOI: DOI not available

Published: Journal: Journal of College of Physicians and Surgeons--Pakistan : JCPSP, Volume: 23, Issue: 12, Year: 2013

Keywords:

multiple choice questions , Assessment , Scrambling , Order sequence , Medical colleges admission test

References:

[1] Bresnock AE,Graves PE,White N .1989 .Multiple-choice testing: question and response position. J Eco Edu, 20 : 239-45.

[2] Sue DL .2009 .The effect of test scrambling on student performance in a small class setting. J Eco Edu, 9 : 32-41.

[3] Zaman A,Kayan MM,Farooqi RA .2009 .Developing and analyzing a multiple choice test in physics for Pakistani secondary. , : .

[4] Lucas SG,Bernstein DA .2005 .Teaching psychology: a step-by-step guide. , : .

[5] Taub AJ,Bell EB .1975 .A bias in scores on multiple-form exams. J Eco Edu, 7 : 58-9.

[6] Balch WR .1989 .Item order affects performance on multiple-choice exams. Teach Psychol, 16 : 75-7.

[7] Zaman A,Niwaz A,Faize AF .2010 .Analysis of multiple choice items and the effect of items' sequencing on difficulty level in the test of mathematic. Eur J Social Sci, 17 : 61-7.

[8] Carlson JL,Ostrosky AL .1992 .Item sequence and student performance on multiple choice exam: further evidence. J Eco Edu, 23 : 232-5.

[9] Doerner WM,Calhoun JP . .The impact of the order of test questions in introductory economics. [updated 2009 Apr, 02 : .

Citations

Downloads

Views