Evaluation of Multiscore Feedback in Professionalism for Anesthesia

Professionalism is one of the six competences required by The Accreditation for Graduate Medical Education Outcome Project to be taught and evaluated during residency. Anesthesia residents are faced with unique communication challenges in their practice including brief contact time with their patients, operating room efficiency pressure, etc. To assess professionalism in Anesthesiology residents is important to obtain evaluations from people with whom they interact including patients, surgeons, colleagues and members of the support team. The Multisource feedback (MSF) approach has been used to evaluate communication skills and professionalism among practicing physicians and residents in a variety of settings. This evaluation model has never been used previously to evaluate anesthesia residents. The investigators propose a randomized controlled trial to validate and evaluate a MSF in professionalism for anesthesia residents. Participants include eighty residents doing two months rotation in Pediatric Anesthesia Department at The Cleveland Clinic Anesthesia Institute from July 1, 2011 and June 30, 2013. MSF questionnaires will be validated using face and content validity methods and comparing them with the current system of evaluation. Residents will be randomly assigned to a feedback group or to the control group. Both groups will receive MSF evaluation from the faculty, patients' parent and coworker. Only the group assigned to feedback is going to have a 'coaching meeting' every month to identify strengths and weaknesses and create strategies for improvement. The investigators are planning to compare the mean values of the baseline evaluations with the mean values obtained after the first and second months from the MSF.

Study Overview

• Status: Completed
• Conditions: CA2 and CA3 Residents Doing a Two Month Rotation in; Pediatric Anesthesia Department
• Intervention / Treatment: Other: Control group; Other: Feedback group

• Study Type: Interventional
• Enrollment (Actual): 28
• Phase: Not Applicable

Contacts and Locations

Study Locations

• United States
  • Ohio
    • Cleveland, Ohio, United States, 44195
      • Cleveland Clinic Foundation

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: ADULT; OLDER_ADULT; CHILD
• Accepts Healthy Volunteers: Yes
• Genders Eligible for Study: All

Description

Inclusion Criteria:

• CA2 and CA3 residents doing a two month rotation in Pediatric Anesthesia Department

Exclusion Criteria:

• N/A

Study Plan

How is the study designed?

Design Details

• Primary Purpose: OTHER
• Allocation: RANDOMIZED
• Interventional Model: SINGLE_GROUP
• Masking: NONE

Number of Arms

2

Arms and Interventions

Participant Group / Arm	Intervention / Treatment
Placebo Comparator: Control Group; Residents will be randomly assigned to a feedback group or to the control group. Besides the standard evaluation at the end of the rotation, in both groups, residents will receive every week a MSF evaluation from the faculty, the patients' parent, and the coworker. Also, for every resident a baseline self assessment will be applied at the beginning and at the end of the rotation. Only the group assigned to feedback is going to have a 'coaching meeting' every month with the Chairman of Department of Pediatric Anesthesia to identify strengths and weaknesses and create strategies for improvement, based on the MSF.	Other: Control group; Besides the standard evaluation at the end of the rotation, in both groups, residents will receive every week a Multiscore Feedback (MSF) evaluation from the faculty, the patients' parent, and the coworker. Also, for every resident a baseline self assessment will be applied at the beginning and at the end of the rotation.
Active Comparator: Feedback group; Residents will be randomly assigned to a feedback group or to the control group. Besides the standard evaluation at the end of the rotation, in both groups, residents will receive every week a MSF evaluation from the faculty, the patients' parent, and the coworker. Also, for every resident a baseline self assessment will be applied at the beginning and at the end of the rotation. Only the group assigned to feedback is going to have a 'coaching meeting' every month with the Chairman of Department of Pediatric Anesthesia to identify strengths and weaknesses and create strategies for improvement, based on the MSF.	Other: Feedback group; Besides the standard evaluation at the end of the rotation, in both groups, residents will receive every week a Multiscore Feedback (MSF) evaluation from the faculty, the patients' parent, and the coworker. Also, for every resident a baseline self assessment will be applied at the beginning and at the end of the rotation. This group is going to have a 'coaching meeting' every month with the Chairman of Department of Pediatric Anesthesia to identify strengths and weaknesses and create strategies for improvement, based on the Multiscore Feedback (MSF).

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Validate Multiscore Feedback (MSF)	To evaluate content validity, copies of the questionnaires will be sent to experts in education in the Anesthesia Institute and Graduate Medical Education at The Cleveland Clinic; they will be asked if the new questionnaires are a good tool to measure professionalism for anesthesia residents	up to 60 days

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
secondary goal is to test a Multiscore Feedback (MSF) as a method of evaluation in professionalism for anesthesia residents.	We will assess the impact of feedback using the MSF (versus no feedback) on the professional behavior of anesthesia residents as measured by the MSF. The randomized groups of residents with and without feedback will be compared on mean MSF score after the first and second months of the rotation using a linear mixed effects model to account for the correlation between measurements on the same resident and to adjust for baseline score as a covariate.	up to 18 months

Collaborators and Investigators

• Sponsor: The Cleveland Clinic
• Investigators: Principal Investigator: Nelson Riveros, M.D., The Cleveland Clinic

Study record dates

Study Major Dates

• Study Start: July 1, 2011
• Primary Completion (Actual): December 1, 2017
• Study Completion (Actual): December 1, 2017

Study Registration Dates

• First Submitted: January 27, 2012
• First Submitted That Met QC Criteria: January 30, 2012
• First Posted (Estimate): January 31, 2012

Study Record Updates

• Last Update Posted (Actual): February 9, 2018
• Last Update Submitted That Met QC Criteria: February 7, 2018
• Last Verified: August 1, 2017

More Information

Terms related to this study

• Keywords: Pediatric Anesthesia; CA2 and CA3 residents
• Other Study ID Numbers: 11-473