Assessment Implementation Measures (AIM): The Journey Towards the Tool Validity

Amara Butt; Yawar Hayat Khan; Muhammad Zeeshan Baig

doi:10.29271/jcpsp.2025.01.90

Author(s)

Amara Butt Department of Medical Education, Rawal Institute of Health Sciences,Islamabad,Pakistan

Yawar Hayat Khan Department of Medical Education, RIPAH International University,Islamabad,Pakistan

Muhammad Zeeshan Baig Department of Oral and Maxillofacial Surgery, Frontier Medical and Dental College,Abbottabad,Pakistan

Abstract

Objective: To establish the construct validity of the Assessment Implementation Measures (AIM) tool to accurately assess faculty perspectives on implemented assessment systems, facilitating the alignment with set standards. Study Design: Qualitative Study. Place and Duration of the Study: The study was carried out at RIPHAH International University and data were collected from participants (senior faculty members) involved in teaching and assessment of undergraduates from various medical and dental colleges in Pakistan. Google form questionnaire was distributed using email and WhatsApp. The data were analysed using IBM AMOS SPSS version 24. Methodology: It was a 30-item tool. The sample size was calculated using 1:10 item-to-participant ratio. Hence data were collected from 313 participants. Con rmatory factor analysis was done to establish construct validity. Results: The indices of con rmatory factor analysis of the tool showed a discrepancy. To remove this discrepancy, items with weak item-loading values were removed. In the end, the tool was reduced to 13 items belonging to three domains. Conclusion: The nal model was improved by excluding items from the original model. A re-validation study with a careful selection of experienced participants from various institutional backgrounds having baseline knowledge of medical education is suggested to improve the results.

Publication Details

Page(s) 90-94

DOI 10.29271/jcpsp.2025.01.90

Published Journal: Journal of College of Physicians and Surgeons--Pakistan : JCPSP, Volume: 35, Issue: 1, Year: 2025

Request the full text from PASTIC

Keywords

medical education, Assessment, AIM Tool, Con rmatory factor analysis

References

Singh T,Gupta P,Dhir SK .2023 .Understanding clinical competence: Understanding student assessment. Indian Pediatr, 60(4) : 267-71.

Naeem NK,Hadie SNH,Ismail IM,Ullah S,Yuso MSB .2024 .Buzz or fuss: Gauging the online learning environments in undergraduate medical education A mixed-method study. doi: 10.21315/eimj2024. 16.2, 16(2) : 63-83.

Alkhateeb NE,Zaidi SH,Hassan S,Bigdeli S,Zehra T .2024 .Global medical education in normal and challenging times. Advances in science, technology & innovation. Cham, 10 : 17.

Garcia-Ros R,Ruescas-Nicolau MA,Cezon-Serrano N,Martin-Valenzuela CS .2024 .Sanchez-Sanchez Improving assessment of procedural skills in health sciences education: A validation study of a rubrics system in neurophysiotherapy. BMC Psychol, 10(1) : 147.

Sajjad M,Khan RA,Yasmeen R .2018 .Measuring assessment standards in undergraduate medical programs: Development and validation of AIM tool. Pak J Med Sci, 10(1) : 164-9.

Aslam K,Khan RA,Aslam MA,Zaidi FZ .2024 .Curriculum implementation challenges: Development and validation of an integrated curriculum implementation challenges tool. Pak J Med Sci, 10(1) : 89-94.

Khan HF,Yasmeen R .2023 .Validation of an assessment tool for professionalism in medical students: A mixed method study. J Pak Med Assoc, 10(11) : 2177-82.

Yilmaz Kogar E,Kogar H. .2024 .A systematic review and metaanalytic con rmatory factor analysis of the perceived stress scale (PSS-10. Stress Health, 10(1) : .

Gogia EH,Shao Z,Khan K,Rehman MZ,Haddad H,AlRamahi NM H .2024 .Exploring the relationship of organizational virtuousness, citizenship behavior, job performance, and combatting ostracism through structural equational modeling. BMC Psychol, 10(1) : 384.

ML. ,Byrne BM .2016 .Structural equation modeling with AMOS: Basic concepts, applications and programming. , 10 : .

Liao Y,Yang J .2023 .Status of nutrition labeling knowledge, attitude, and practice (KAP) of residents in the community and structural equation modeling analysis. Front Nutr, 1097562 : 1097562.

Raheel H,Naeem NJJPMA .2013 .Assessing the objective structured clinical examination: Saudi family medicine undergraduate medical students perceptions of the tool. J Pak Med Assoc, 63(10) : 1281-4.