Procedure-based assessments for evaluating trainees' skills in the operating theater: Perceptions of trainees and assessors in Gynecology and Obstetrics department

Fareesa Waqar; Beenish Riaz; Huma Afridi; Wajiha Shadab; Itaat Ullah Khan Afridi

Author(s)

Fareesa Waqar Department of Obstetrics and Gynecology, Islamic International Medical College, Riphah University Islamabad, Pakistan

Beenish Riaz Department of Obstetrics and Gynecology, Islamic International Medical College, Riphah University Islamabad, Pakistan

Huma Afridi Sialkot Medical College, Sialkot, Pakistan

Wajiha Shadab Department of Obstetrics and Gynecology, Islamic International Medical College, Riphah University Islamabad, Pakistan

Itaat Ullah Khan Afridi NSML, Gujrat, Pakistan

Abstract

Objective: To investigate the perceptions of trainees and assessors regarding Direct Observation of Procedural Skills (DOPS) in the Obstetrics and Gynecology department. Methodology: This prospective mixed-methods study was conducted over six months at Pakistan Railway Hospital, Rawalpindi. Twenty-two postgraduate trainees and six faculty members participated, with DOPS introduced through theoretical and practical sessions. A validated questionnaire assessed perceptions, and DOPS forms were adapted and validated for procedural checklists. Trainees underwent DOPS assessments three times per procedure, with feedback provided privately. Quantitative and qualitative data were analyzed to evaluate perceptions and effectiveness. Results: Trainees generally viewed DOPS favorably, noting its contribution to skill enhancement, valuable feedback, and improved student-teacher relationships. Faculty members also appreciated DOPS for its com-prehensive evaluation and ease of implementation, though some noted its time-consuming nature. Thema-tic analysis revealed DOPS's effectiveness in highlight-ing performance gaps and enhancing procedural skills, though challenges included variability in assessor feed-back and the need for consistent planning. Conclusion: DOPS is viewed as an effective tool for both assessment and teaching by postgraduate students and faculty. With proper training, planning, and sche-duling, its implementation is feasible. Integrating DOPS into the postgraduate gynecology and obstetrics curri-culum will advance competency-based training.

Publication Details

Page(s) 479-483

DOI DOI not available

Published Journal: Rawal Medical Journal, Volume: 50, Issue: 2, Year: 2025

Request the full text from PASTIC

Keywords

Perception, Gynecology, Obstetrics., Operating theatre

References

Alpine L,Barrett E,Broderick J,Mockler D,O'Connor A. .2024 .Education programs on performance-based assessment for allied health and nursing clinical educators: A scoping review protocol. HRB Open Res, 6 : 11-5.

Khan Abbas,Gorman MA,Gwozdziewicz M,Sobani L,Gibson ZA,C ZA .2013 .Direct Observation of Procedural Skills (DOPS) as an Assessment Tool for Surgical Trainees. J Pak Med Students, 3 : 137-40.

Lörwald AC,Lahner FM,Nouns ZM,Berendonk C,Norcini J,Greif R .2018 .The educational impact of Mini-Clinical Evaluation Exercise (Mini-CEX) and Direct Observation of Procedural Skills (DOPS) and its asso-ciation with implementation: A systematic review and meta-analysis. PLoS One, 13 : 1-15.

Hengameh H,Afsaneh R,Morteza K,Hosein M,Marjan SM Azhar .2015 .The Effect of Applying Direct Obser-vation of Procedural Skills (DOPS) on Nursing Students' Clinical Skills: A Randomized Clinical Trial. Glob J Health Sci, 7 : 17-21.

Phillips AW .2017 .Exploring surgical and clinical skills learn-ing in postgraduate and undergraduates. Master's thesis, : .

Ismail FW,Afzal A,Durrani R,Qureshi R,Awan S,Bro-wn MR .2024 .Exploring Endoscopic Competence in Gastroenterology Training: A Simulation-Based Comparative Analysis of GAGES, DOPS, and ACE Assessment Tools. Adv Med Educ Pract, 15 : 75-84.

Aryal KR .2019 .The Utility of Work-Based assessments in higher general surgical training - a systematic review. Res Square, : 1-21.

Wang Y,Chen G,Chen J,Jiang F .2024 .Application of Mini-CEX combined with DOPS in standardized training of community outpatient residents. BMC Med Educ, 24 : 1-5.

Khanghahi ME,Azar FEF .2018 .Direct observation of pro-cedural skills (DOPS) evaluation method: Systematic rev-iew of evidence. Med J Islam Repub Iran, 32 : 254-61.

Lörwald AC,Lahner FM,Greif R,Berendonk C,Norcini J,Huwendiek S. .2018 .Factors influencing the educational impact of Mini-CEX and DOPS: A qualitative synthesis. Med Teach, 40 : 414-20.

Lörwald AC,Lahner FM,Mooser B,Perrig M,Widmer MK,Greif R .2019 .Influences on the implementation of Mini-CEX and DOPS for postgraduate medical trainees' learning: A grounded theory study. Med Teach, 41 : 448-56.

Far Ajpou R A,Amini MA,Pi Sh Bi N AM MA,Mostafavian ZA,Akbar S,Far I .2018 .Using modified (DOPS) to assess undergraduate medical students Using modified Direct Observation of Procedural Skills (DOPS) to assess undergraduate medical students. J Adv Med Educ Prof July, 6 : 130-6.

Hammoud MM,Dalymple JL,Christner JG,Stewart RA,Fisher J,Margo K .2012 .Medical Student Documentation in Electronic Health Records: A Collaborative Statement from the Alliance for Clinical Education. Teach Learn Med, 24 : 257-66.

.2018 .(Dec. ANZCA Handbook for Training, : .

Kundra S,Singh T. Feasibility .2014 .and acceptability of direct observation of procedural skills to improve procedural skills. Indian Pediatr, 51 : 59-60.

Cobb KA,Brown G,Jaarsma DADC,Hammond RA .2013 .The educational impact of assessment: A comparison of DOPS and MCQs. Med Teach, : 35.

Siau K,Crossley J,Dunckley P,Johnson G,Haycock A,Anderson JT .2019 .Training and assessment in flexible sigmoidoscopy: Using a novel direct observation of procedural skills (DOPS) assessment tool. J Gastrointest Liver Dis, 28 : 33-40.

Rela M,Price T. .2023 .Review of the validity of DOPS as an assessment tool for the procedural skills of surgical trai-nees. Ann R Coll Surg Engl, 105 : 599-606.

Qi D,Zhu L,Wang S,Yu X .2020 .Application of Formative Evaluation with DOPS in Graduation Internship in Gen-eral Practice Department. Chin Gen Pract, 23 : 3216-9.

Dabir S,Hoseinzadeh M,Mosaffa F,Hosseini B,Dahi M,Vosoughian M .2021 .The effect of repeated direct observation of procedural skills (R-DOPS) assessment method on the clinical skills of anesthesiology residents. Anesthesiol Pain Med, 11 : 1-6.