Evaluation of Changes in Quality Improvement Knowledge Following a Formal Educational Curriculum Within a Statewide Learning Collaborative

J Surg Educ. 2020 Nov-Dec;77(6):1534-1541. doi: 10.1016/j.jsurg.2020.04.018. Epub 2020 Jun 15.

Abstract

Objective: Our objectives were to (1) develop a curriculum based upon participants' needs, (2) evaluate baseline QI knowledge of the Illinois Surgical Quality Improvement Collaborative (ISQIC) members, and (3) evaluate the effectiveness of the educational curriculum.

Design: The Surgeon Champion (SC), Surgical Clinical Reviewer (SCR), and QI Designee at each ISQIC hospital completed a QI curriculum containing online modules and in-person trainings. A surgical adaptation of QI-KAT, a validated QI knowledge assessment with multiple-choice and free-response sections, was administered pre- and postcurriculum. Three blinded educators scored each exam using a rubric-based scoring tool (54 total points).

Setting: The ISQIC is a 52-hospital learning collaborative. Generally, ISQIC participants had little prior formal training or experience with quality improvement.

Results: Among 52 hospitals, 144 pretests and 112 post-tests were collected. Mean scores increased from 66% (35.6 points) to 77% (41.6 points; p < 0.001). Across all hospitals, all participant groups scored higher on the post-test (SCs 15%, SCRs 21%, QI Designees 17%). There was no significant difference in post-test mean scores among different team members: SCs 44 points, SCRs 42 points, QI Designees 44 points, (p = 0.76). When the post-test scores were aggregated at the hospital level, hospitals with new surgical QI programs improved more than hospitals with established programs (new 18%, established 11%, p < 0.05).

Conclusions: QI knowledge significantly improved after completion of the ISQIC curriculum. These data support the value of formalized curricula to rapidly advance QI knowledge and application skills as a foundation for implementing QI initiatives.

Keywords: Quality Improvement Collaborative (QIC); curriculum; education; process improvement; quality improvement; surgery.

MeSH terms

  • Curriculum
  • Education, Medical, Graduate
  • Humans
  • Illinois
  • Internship and Residency*
  • Quality Improvement*