The Effect of Judge Selection on Standard Setting Using the Mastery Angoff Method during Development of a Ventricular Assist Device Self-Care Curriculum

Clin Simul Nurs. 2019 Feb:27:39-47.e4. doi: 10.1016/j.ecns.2018.10.005. Epub 2018 Nov 27.

Abstract

Background: Patients and caregivers need to perform ventricular assist device (VAD) self-care safely to help prevent complications (e.g., infection). We developed a VAD self-care simulation-based mastery learning (SBML) curriculum. We determined optimal minimum passing scores (MPSs) and evaluated effects of judge selection.

Methods: A multidisciplinary team created a VAD self-care SBML curriculum including simulated skills and knowledge examinations. Patients, caregivers, VAD coordinators, and physicians were expert judges who determined MPSs using the Mastery Angoff method.

Results: MPSs for the skills and knowledge examinations were high (range = 94-99% and 97% correct), respectively. Judges closely agreed on MPSs.

Conclusions: Stakeholders set stringent MPSs for high-stakes VAD self-care.

Keywords: Mastery Angoff; Mastery Learning; Self-care; Simulation; Standard Setting; Ventricular Assist Device.