Show simple item record

dc.contributor.supervisor Park, Jason (Surgery) en_US
dc.contributor.author Maniar, Reagan
dc.date.accessioned 2017-01-05T20:50:41Z
dc.date.available 2017-01-05T20:50:41Z
dc.date.issued 2016
dc.identifier.uri http://hdl.handle.net/1993/31990
dc.description.abstract Rater training (RT) improves the reliability of assessment tools, but has not been well studied for technical skills. This study assessed whether RT improved the psychometric properties of surgical skill assessments. Surgeons (N=47) were randomized to RT or non-training groups. The RT group underwent frame-of-reference training. Participants assessed trainees performing a suturing and knot-tying task using four assessment tools. Inter-rater reliability, initial and delayed rater agreement, and construct validity were assessed between groups. There was no significant effect of RT on the assessment tools’ reliability and validity. Reliability and validity were most robust for the global rating scale. Although there were trends towards improved reliability and validity with RT, confidence intervals were wide and overlapping. Reliability remained below the minimum desired level of 0.8 required for high-stakes testing. Although RT may represent a way to improve reliability, further study is needed to determine effective training methods. en_US
dc.subject Surgical education en_US
dc.subject Rater training en_US
dc.subject Technical skills en_US
dc.subject Technical skill assessments en_US
dc.title The effect of rater training on the reliability and validity of technical skill assessments: a randomized control trial en_US
dc.degree.discipline Surgery en_US
dc.contributor.examiningcommittee Hardy, Krista (Surgery) McKay, Andrew (Surgery) Francois, Jose (Family Medicine) en_US
dc.degree.level Master of Science (M.Sc.) en_US
dc.description.note February 2017 en_US


Files in this item

This item appears in the following Collection(s)

Show simple item record

View Statistics