Gaining Insight into Operative Performance: Analysis of an Automated 360-Degree Feedback Tool Among Perioperative Staff

Background:. Surgery has seen limited adoption of 360-degree feedback tools, and no current tools evaluate intraoperative performance from a technical, nontechnical, or teaching skill perspective. We sought to evaluate the overall findings and perceived value of a novel 360-degree feedback tool for...

Full description

Saved in:
Bibliographic Details
Main Authors: Stefanie J. Soelling, MD, MPH, Robert D. Sinyard, MD, Lauren Spigel, MPH, Max Riley, MD, Paul Gregory, PhD, Nick Perdomo, MS, Yves Sonnay, MScPH, Steven Yule, PhD, Steven J. Fishman, MD, Douglas S. Smink, MD, MPH, FACS
Format: Article
Language:English
Published: Wolters Kluwer Health 2024-12-01
Series:Annals of Surgery Open
Online Access:http://journals.lww.com/10.1097/AS9.0000000000000532
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832589685103263744
author Stefanie J. Soelling, MD, MPH
Robert D. Sinyard, MD
Lauren Spigel, MPH
Max Riley, MD
Paul Gregory, PhD
Nick Perdomo, MS
Yves Sonnay, MScPH
Steven Yule, PhD
Steven J. Fishman, MD
Douglas S. Smink, MD, MPH, FACS
author_facet Stefanie J. Soelling, MD, MPH
Robert D. Sinyard, MD
Lauren Spigel, MPH
Max Riley, MD
Paul Gregory, PhD
Nick Perdomo, MS
Yves Sonnay, MScPH
Steven Yule, PhD
Steven J. Fishman, MD
Douglas S. Smink, MD, MPH, FACS
author_sort Stefanie J. Soelling, MD, MPH
collection DOAJ
description Background:. Surgery has seen limited adoption of 360-degree feedback tools, and no current tools evaluate intraoperative performance from a technical, nontechnical, or teaching skill perspective. We sought to evaluate the overall findings and perceived value of a novel 360-degree feedback tool for surgeons from their operating room colleagues. Methods:. The ‘intraoperative 360’ (i360) combined 3 previously validated scales of surgeon performance. The electronic medical record at a single academic medical center was queried for perioperative staff involvement in recent cases for a cohort of surgeons. Staff with frequent surgeon case involvement were emailed a link to an anonymous i360 survey. Aggregated survey responses were provided to surgeons and surgical leadership. We performed semi-structured interviews with 10 surgeons and 5 surgical leaders. Combined inductive and deductive coding was used to determine their perceptions regarding the utility of and barriers to the i360. Results:. Over 2-years, a total of 960 surveys were completed for 88 surgeons. The composite rating of technical skills was 4.87/5 (SD: 0.36); nontechnical skills, 4.65/5 (SD: 0.55); and teaching skills, 2.92/3 (SD: 0.24). There was no difference in mean scores based on gender, age, or years of tenure. Six themes emerged from the interviews: initial reactions, utility, additional needs, other feedback mechanisms, reciprocal feedback, and logistical challenges. Conclusions:. A 360-degree feedback tool is feasible, and feedback is perceived as valuable and actionable for surgeons and surgeon leaders. The intraoperative focus provided surgeons with specific feedback on how to improve within the operating room to promote efficiency, teamwork, and patient safety.
format Article
id doaj-art-23d1f6bc014340d595f85a797243cd42
institution Kabale University
issn 2691-3593
language English
publishDate 2024-12-01
publisher Wolters Kluwer Health
record_format Article
series Annals of Surgery Open
spelling doaj-art-23d1f6bc014340d595f85a797243cd422025-01-24T09:18:59ZengWolters Kluwer HealthAnnals of Surgery Open2691-35932024-12-0154e53210.1097/AS9.0000000000000532202412000-00037Gaining Insight into Operative Performance: Analysis of an Automated 360-Degree Feedback Tool Among Perioperative StaffStefanie J. Soelling, MD, MPH0Robert D. Sinyard, MD1Lauren Spigel, MPH2Max Riley, MD3Paul Gregory, PhD4Nick Perdomo, MS5Yves Sonnay, MScPH6Steven Yule, PhD7Steven J. Fishman, MD8Douglas S. Smink, MD, MPH, FACS9From the * Department of Surgery, Brigham & Women’s Hospital, Boston, MA† Ariadne Labs, Harvard School of Public Health, Brigham and Women’s Hospital, Boston, MA† Ariadne Labs, Harvard School of Public Health, Brigham and Women’s Hospital, Boston, MAFrom the * Department of Surgery, Brigham & Women’s Hospital, Boston, MA§ Pulse 360, Inc., Orlando, FL§ Pulse 360, Inc., Orlando, FL† Ariadne Labs, Harvard School of Public Health, Brigham and Women’s Hospital, Boston, MA∥ College of Medicine and Veterinary Sciences, Usher Institute, Unversity of Edinburgh, Edinburgh, UK¶ Department of Surgery, Boston Children’s Hospital, Boston, MA.From the * Department of Surgery, Brigham & Women’s Hospital, Boston, MABackground:. Surgery has seen limited adoption of 360-degree feedback tools, and no current tools evaluate intraoperative performance from a technical, nontechnical, or teaching skill perspective. We sought to evaluate the overall findings and perceived value of a novel 360-degree feedback tool for surgeons from their operating room colleagues. Methods:. The ‘intraoperative 360’ (i360) combined 3 previously validated scales of surgeon performance. The electronic medical record at a single academic medical center was queried for perioperative staff involvement in recent cases for a cohort of surgeons. Staff with frequent surgeon case involvement were emailed a link to an anonymous i360 survey. Aggregated survey responses were provided to surgeons and surgical leadership. We performed semi-structured interviews with 10 surgeons and 5 surgical leaders. Combined inductive and deductive coding was used to determine their perceptions regarding the utility of and barriers to the i360. Results:. Over 2-years, a total of 960 surveys were completed for 88 surgeons. The composite rating of technical skills was 4.87/5 (SD: 0.36); nontechnical skills, 4.65/5 (SD: 0.55); and teaching skills, 2.92/3 (SD: 0.24). There was no difference in mean scores based on gender, age, or years of tenure. Six themes emerged from the interviews: initial reactions, utility, additional needs, other feedback mechanisms, reciprocal feedback, and logistical challenges. Conclusions:. A 360-degree feedback tool is feasible, and feedback is perceived as valuable and actionable for surgeons and surgeon leaders. The intraoperative focus provided surgeons with specific feedback on how to improve within the operating room to promote efficiency, teamwork, and patient safety.http://journals.lww.com/10.1097/AS9.0000000000000532
spellingShingle Stefanie J. Soelling, MD, MPH
Robert D. Sinyard, MD
Lauren Spigel, MPH
Max Riley, MD
Paul Gregory, PhD
Nick Perdomo, MS
Yves Sonnay, MScPH
Steven Yule, PhD
Steven J. Fishman, MD
Douglas S. Smink, MD, MPH, FACS
Gaining Insight into Operative Performance: Analysis of an Automated 360-Degree Feedback Tool Among Perioperative Staff
Annals of Surgery Open
title Gaining Insight into Operative Performance: Analysis of an Automated 360-Degree Feedback Tool Among Perioperative Staff
title_full Gaining Insight into Operative Performance: Analysis of an Automated 360-Degree Feedback Tool Among Perioperative Staff
title_fullStr Gaining Insight into Operative Performance: Analysis of an Automated 360-Degree Feedback Tool Among Perioperative Staff
title_full_unstemmed Gaining Insight into Operative Performance: Analysis of an Automated 360-Degree Feedback Tool Among Perioperative Staff
title_short Gaining Insight into Operative Performance: Analysis of an Automated 360-Degree Feedback Tool Among Perioperative Staff
title_sort gaining insight into operative performance analysis of an automated 360 degree feedback tool among perioperative staff
url http://journals.lww.com/10.1097/AS9.0000000000000532
work_keys_str_mv AT stefaniejsoellingmdmph gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff
AT robertdsinyardmd gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff
AT laurenspigelmph gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff
AT maxrileymd gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff
AT paulgregoryphd gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff
AT nickperdomoms gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff
AT yvessonnaymscph gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff
AT stevenyulephd gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff
AT stevenjfishmanmd gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff
AT douglasssminkmdmphfacs gaininginsightintooperativeperformanceanalysisofanautomated360degreefeedbacktoolamongperioperativestaff