Exploring the experiences of content experts with item vetting during item bank development

TL;DR

This study explores how content experts feel about item vetting during the development of item banks for assessments at a medical university in Pakistan.

Contribution

The study provides insights into the experiences and perceptions of content experts during item vetting in item bank development.

Findings

Content experts felt satisfied and valued their role in refining MCQ construction skills.

Item vetting and adherence to protocols enhance the quality of assessments and item development.

The process supports fair assessment and contributes to producing competent healthcare professionals.

Abstract

To explore content experts’ experiences with item vetting during item bank development at a public sector medical university of Rawalpindi, Pakistan.

An exploratory study was carried out from December 2022 to February 2023 at a public sector medical college of Rawalpindi. A purposive sampling technique was employed to collect data from all content experts of the study institute who participated in item vetting activity during pre-exam moderation in the university. A pilot-tested semi-structured interview guide was utilized, interviews were audio recorded and later transcribed. Participants’ anonymity was ensured. Various quality assurance strategies were employed to ensure the trustworthiness of the findings. Thematic analysis was performed on the transcribed data and themes were finalized by achieving consensus among all authors.

Six themes overarching the fourteen subthemes emerged from the data. Participants expressed a profound sense of satisfaction and valued their experience in refining expertise in constructing multiple-choice questions (MCQs). It was widely acknowledged that such activities not only contribute to the enhancement of item development skills but also improve quality of items.

The consistent implementation of item vetting routines, in conjunction with diligent adherence to item writing protocols, contributes to quality assurance measures in assessment. Item bank development for fair and transparent assessment ensures production of competent healthcare professionals filtering incompetent ones hence improving health care services in the community.