Clinical Science

Psychometric Properties of a New Tool to Assess Task-Specific and Global Competency in Cataract Surgery

Dan B. Rootman, MSc, MD; Kay Lam, MD; Marisa Sit, MD, FRCSC; Eugene Liu, MD, FRCSC; Adam Dubrowski, PhD; Wai-Ching Lam, MD, FRCSC

  • Ophthalmic Surgery, Lasers and Imaging
  • May/June 2012 - Volume 43 · Issue 3: 229-234
  • DOI: 10.3928/15428877-20120315-02
Rights and Permissions

Abstract

BACKGROUND AND OBJECTIVE:

To establish and validate an assessment tool of cataract surgery performed by residents suitable for a competency-based curriculum.

PATIENTS AND METHODS:

A three-component evaluation tool was created based on review of the literature and was refined using a modified Delphi technique. Faculty surgeons viewed two videos of cataract surgery, performed by a novice and an expert, and completed the evaluation tool. Results were analyzed for the psychometric properties.

RESULTS:

Evaluators concluded the scale had excellent face validity. Construct validity showed the scale to reliably distinguish (P < .001) between novice (30.3 ± 6.1) and experienced (48.3 ± 7.2) surgeons. Internal consistency of the scale was high, with Cronbach’s alpha equal to 0.981. Inter-rater reliability was high with an intraclass correlation coefficient equal to 0.811 (F(df) = 53.2 (25), P < .001).

CONCLUSION:

The tool has excellent face validity, content validity, and reliability. Its task-specific, global-index scale and quantitative data form make it a valuable tool to assess residents’ surgical skills.

AUTHORS

From the University of Toronto (DBR, MS, KL, AD, W-CL), Toronto, Ontario, Canada; University Health Network (MS, W-CL), Toronto, Ontario, Canada; Mt. Sinai Hospital (EL), Toronto, Ontario, Canada; and the Wilson Centre (AD), University of Toronto, Toronto, Ontario, Canada.

Presented as a poster at The Royal College’s International Conference on Residency Education, September 23–25, 2010, Ottawa, Ontario, Canada.

The authors have no financial or proprietary interest in the materials presented herein.

Address correspondence to Dan B. Rootman, MSc, MD, Toronto Western Hospital, East Wing 6-401, 399 Bathurst Street, Toronto, Ontario M5T 2S8, Canada. E-mail: dan.rootman@gmail.com

Received: July 09, 2011
Accepted: February 15, 2012
Posted Online: March 22, 2012

doi: 10.3928/15428877-20120315-02

Healio is intended for health care provider use and all comments will be posted at the discretion of the editors. We reserve the right not to post any comments with unsolicited information about medical devices or other products. At no time will Healio be used for medical advice to patients.

[X]