No Detail Found!

Inter-rater Reliability of Objective Structured Long Examination Record.

Author(s)
Syed Inamullah Shah Department of Surgery, Foundation University Medical College, Islamabad,
Mehreen Baig Department of Surgery, Foundation University Medical College, Islamabad,
Sajida Shah Shifa International Hospital, Islamabad, Pakistan
Eitezaz Ahmad Bashir Department of Surgery, Foundation University Medical College, Islamabad,
Hajira Sarwar Department of Surgery, Foundation University Medical College, Islamabad,
Jamil Ahmad Shah Department of Surgery, Foundation University Medical College, Islamabad,
Abstract
Background: Objective Structured Long Examination Record (OSLER) scale was introduced in 1997 by Gleeson to improve the long case examination. There is no psychometric evidence to support reliability of OSLER. This study was done to analyse inter-rater reliability of OSLER. Methods: Two groups of examiners assessed 105 students in long case examination of their final professional examination, using OSLER scale. Group 1 was composed of actual examiners while Group 2 was mock examiners. Kappa statistic and intraclass correlation coefficient (ICC) were used on SPSS 23 to calculate reliability. Results: Mean score awarded by actual examiners was 55.36 (SD=11.2) whereas mean score by mock examiners was 57.74 (SD=14.1). Cronbach's alpha was 0.586, Kappa was 0.019 whereas inter-rater reliability on ICC was 0.413. Conclusion: Although OSLER is a practical modification of long case examination with good validity, the scale needs to be more structured to improve its reliability.
Publication Details
Page(s) 180-183
DOI DOI not available
Published Journal: Journal of Ayub Medical College, Volume: 30, Issue: 2, Year: 2018

Request the full text from PASTIC

Keywords
NULLL
References
DareAJ,CardinalA,KolbeJ,BaggW.,,2008,What can history tell us? An argument for observed history-taking in the trainee intern long case assessment,N Z Med J,121,51-7
WilkinsonTJ,CampbellPJ,JuddSJ,,2008,Reliability of the long case,Med Educ,42,887-93
Smee S.,,2003,ABC of learning and teaching in medicine,Skill based assessment. Br Med J,326,703-6
TronconEA,FernandoROD,FigueiredoC,FerriolliE,Moriguti LioC,Martinelli AnaLC,,2000,A standardized, structured long-case examination of clinical competence of senior medical students,Med Teach,22,380-5
WassV,Van der Vleuten C.,,2004,The long case,Med Educ,38,1176-80
TeohNC,BowdenFJ,,2008,The case for resurrecting the long case,BMJ,336,1250-
Thornton S.,,2012,A literature review of the long case and its variants as a method of assessment,Educ Med J,4,e5-14
PonnamperumaGG,KarunathilakeIM,McAleerS,,,,,,-
,2009,The long case and its modifications: a literature review,Med Educ,43,936-41
SoodR.,,2001,Long case examination - Can it,J Indian Acad Clin Med,2,252-5
NorciniJJ,LipnerRS,KimballHR,,2002,Certifying examination performance and patient outcomes following acute myocardial infarction,Med Educ,36,853-9
NewbleDI,,1991,The observed long case in clinical assessment,Med Educ,25,369-73
AbounaGM,,1999,The integrated direct observation clinical encounter examination (IDOCEE) - an objective assessment of students' clinical competence in a problem-based learning curriculum,Med Teach,21,67-72
GleesonF.,,1997,AMEEN medical education guide no 9: Assessment of clinical competence using the Objective Structured Long Examination Record (OSLER),Med Teach,19,7-14
BannerjiM,CapozzoliM,McSweeneyL,SinhaD.,Beyond,,1999,Kappa: A review of inter-rater agreement measures,Can J Stat,27,3-23
WeirJP,,2005,Quantifying test-retest reliability using intraclass correlation coefficient and SEM,J Strength Cond Res,19,231-40
VieraJA,GarrettJM,,2005,Understanding inter-observer agreement: The Kappa Statistic,Fam Med,37,360-3
BarzanskyB,EtzelSI,,2010,Medical schools in the United States,,JAMA,304,1247-54
BentleyBS,HillRV,,2009,Objective and subjective assessment of reciprocal peer teaching in medical gross anatomy laboratory,Anat Sci Educ,2,143-9
KamarudinMA,MohamadN,HalizahMN,YamanMN,,2012,The Relationship between Modified Long Case and Objective Structured Clinical Examination (OSCE) in final professional examination 2011 held in UKM Medical Centre,ProcediaSoc Behav Sci,60,241-8
MalikA,BhugraD,MalikA,BhugraD,BrittlebankA,,2011,Workplace based assessment methods: literature overview,Workplace-based assessments in psychiatry. 2nd ed. London: RCPsych Publications,,14-27
KrobothFJ,HansusaBH,ParkerS,coulehanJL,KapoorWN,BrownFH,,1992,The inter-rater reliability and internal consistency of a clinical evaluation exercise,J Gen Intern Med,7,174-9
WassV,JollyB,,2001,Does observation add to the validity of the long case?,Med Educ,35,729-34
NithyanandamS,JosephM,VasuU,,2012,Can conventional long case examination be improved?,Indian J Ophthalmol,60,333-
0

Citations

0

Downloads

39

Views