No Detail Found!

Role of Faculty Development Workshop for Improving MCQS Quality in Basic Medical Sciences

Author(s)
Mirza Aroosa Beg Department of Medical Education, Sindh Institute of Urology and Transplantation (SIUT), Karachi, Pakistan
Afifa Tabassum Department of Health Professions Education, Liaquat National Hospital and Medical College, Karachi , Pakistan
Sobia Ali Department of Health Professions Education, Liaquat National Hospital and Medical College, Karachi - Pakistan.
Abstract
Background and Objective: Multiple-choice questions (MCQs) are a frequently used method of assessment in medical education. MCQs have to be well-constructed and have minimal flaws to achieve higher reliability and validity. Developing high quality MCQs is difficult but formal faculty training has found to have a positive impact on MCQ writing skills and quality. The purpose of the study was to assess the effect of a one-day training session on the quality of MCQs and the change in faculty's self-rating of their competency in MCQ construction. Methods: This was a quasi-experimental study. A targeted workshop was conducted to train 17 faculty members in item writing skills and to improve the quality of existing item bank. Training was provided on the process of developing high quality assessment items and methods to avoid item flaws. Analysis of 48 MCQs from the existing MCQ bank was done for critique and improvement in quality. The MCQs were analyzed for level and type of questions and presence of item writing flaws. Faculty self-rating of their competency before and after the workshop session was also collected. Wilcoxon rank sum test was used to determine any change in the pre and post workshop quality of MCQs. Paired t-test was applied to analyze change in participants' perception of their competency before and after the workshop session. Results: Analysis showed that after the workshop, the number of MCQs testing recall reduced significantly (N 42, 30, P = 0.05). Similarly, questions testing application of knowledge improved significantly (N 6, 17, P = 0.05). Analysis of faculty's self-rating of “change in competency” showed a significant improvement (P = 0.00) in their ability to improve the stem, lead-in and options list with appropriate and logically sequenced distractors. Conclusion: Targeted faculty development workshops improve the quality of MCQs construction. These trainings should be well structured and conducted on regular basis for better outcome.
Publication Details
Page(s) 51-55
Published Journal: Biomedica, Volume: 37, Issue: 1, Year: 2021

Request the full text from PASTIC

Keywords
workshops, Faculty development, multiple choice questions, Educational assessment
References
DiBattista D .2011 .Examination of the quality of multiple-choice items on classroom tests. CJSoTL, 2(2) : 4-23.
Khan HF,Danish KF,Awan AS,Anwar M .2013 .Identification of technical item flaws leads to improvement of the quality of single best multiple choice questions. Pak J Med Sci, 10(3) : 715-8.
Webb EM,Phuong JS,Naeger DM .2015 .Does educator training or experience affect the quality of multiplechoice questions?. org/10, 06(10) : 1317-22.
Baig M,Ali SK,Ali S,Huda N. .2014 .Evaluation of multiple choice and short essay question items in basic medical sciences. Pak J Med Sci, 10(1) : 3-6.
Tarrant M,Knierim A,Hayes SK,Ware J. .2006 .The frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments. Nurse Edu Today, 07(8) : 662-71.
Iramaneerat C. .2012 .The impact of item writer training on item statistics of multiple-choice items for medical student examination. Siriraj Med, 64(6) : 178-182.
Ali R,Sultan AS,Zahid N. .2021 .Evaluating the effectiveness of MCQ development workshop using cognitive model framework: A pre-post study. J Pak Med Assoc, 71(1) : 1-6.
Abdulghani HM,Ahmad F,Irshad M,Khalil MS,AlShaikh GK,Syed S .2015 .Faculty development programs improve the quality of Multiple Choice Questions items' writing. Sci Reports, 5(1) : 1-7.
Naeem N,Van der Vleuten C,Alfaris EA .2012 .Faculty development on item writing substantially improves item quality. Adv Health Sci Educ, 10(3) : 369-76.
Chandra S,Katyal R,Chandra S,Singh K,Singh A,Joshi HS .2018 .Creating valid multiple-choice questions (MCQs) bank with faculty development of Pharmacology. Indian J Physiol Pharmacol, 62(3) : 359-66.
Epstein RM .2007 .Assessment in medical education. N Engl J Med, 10(4) : 387-96.
Abdulghani HM,Irshad M,Haque S,Ahmad T,Sattar K,Khalil MS .2017 .: e0185895. PloS One, 12(10) : .
Ul Z,Usmani A .2017 .Psychometric analysis of Anatomy MCQs in Modular examination. Pak J Med Sci, 10(5) : 1138-43.
Al-Faris E,Naeem N,Irfan F,Qureshi R,Saad H,Al Sadhan RE .2015 .A one‐day dental faculty workshop in writing multiple‐choice questions: an impact evaluation. J Dent Educ, 79(11) : 0337-13.
Gupta P,Meena P,Khan AM,Malhotra RK,Singh T .2020 .Effect of faculty training on quality of multiplechoice questions. Int J App Basic Med Res, 30(3) : 20-6.
Sezari P,Tajbakhsh A,Massoudi N,Dolatabadi AA,Tabashi S,Sayyadi S .2020 .Evaluation of one-day multiple-choice question workshop for Anesthesiology faculty members. Anesth Pain Med, 10(6) : 31.
0

Citations

0

Downloads

14

Views