Types of item writing flaws in multiple choice questions in medical education and their effect on passing rate of students | [Pakistan Journal of Physiology • 2023]

Author(s):

1. Sarmud Latif Awan: Department of Surgery, Abbas Institute of Medical Sciences, Muzaffarabad, AJK, Pakistan

2. Shagufta Manzoor: Anatomy, AJK Medical College,Muzaffarabad, Pakistan

3. Irum Gillani: Department of Public Health and Community Medicine, Health Services Academy Islamabad, Pakistan

4. Ziyad Afzal Kiyani: Department of Surgery, Abbas Institute of Medical Sciences, Muzaffarabad, AJK, Pakistan

5. Humza Farooq: Department of Surgery Shifa International Hospital, Islamabad, Pakistan

6. Sahar Khurshid: Department of Surgery, Abbas Institute of Medical Sciences, Muzaffarabad, AJK, Pakistan

Abstract:

Background: The most popular written exam in health professions education is the multiplechoice style question (MCQ). This study sought to understand the effects of multiple-choice writing errors on students' academic performance in medical education. Methods: This descriptive study was done from December 2017 to June 2019 in Azad Jammu Kashmir (AJK) Medical College, Muzaffarabad. Ten block examinations were included. The item review committee reviewed all MCQs for flaws. Two tests from each class of MBBS were taken. The original tests containing all items were labeled as flawed tests and the result of each flawed test was evaluated. The students were graded into high, moderate and low achievement groups with scores of more than 79.9, between 50-79.9 and less than 50 percent respectively. Flawed items were then removed from the tests by the review committee and the scores of each test (standard test) were determined and compared with flawed tests and its effects were assessed in three achieving groups of students. Optical mark reading (OMR) classic-4 software was used for post-exam analysis and data were analyzed by using SPSS-25. Results: The passing rate ranged from 68.18% to 90.82% in flawed and 75.54% to 93.69% in standard tests. Most standard tests (7) had higher passing rates than flawed tests. Conclusion: Tests containing in-house developed MCQs have frequent item writing flaws and their inclusion in assessment did affect the passing rates of students but were not statistically significant.

Page(s): 49-52

DOI: DOI not available

Published: Journal: Pakistan Journal of Physiology, Volume: 19, Issue: 4, Year: 2023

Keywords:

MCQs , Academic achievements , flawed items

References:

References are not available for this document.

Citations

Citations are not available for this document.

Citations

Downloads

Views