Tracking operative autonomy and performance in otolaryngology training using smartphone technology: A single institution pilot study
dc.contributor.author | Chen, Jenny X. | |
dc.contributor.author | Kozin, Elliott | |
dc.contributor.author | Bohnen, Jordan | |
dc.contributor.author | George, Brian | |
dc.contributor.author | Deschler, Daniel | |
dc.contributor.author | Emerick, Kevin | |
dc.contributor.author | Gray, Stacey T. | |
dc.date.accessioned | 2020-01-13T15:14:11Z | |
dc.date.available | WITHHELD_12_MONTHS | |
dc.date.available | 2020-01-13T15:14:11Z | |
dc.date.issued | 2019-12 | |
dc.identifier.citation | Chen, Jenny X.; Kozin, Elliott; Bohnen, Jordan; George, Brian; Deschler, Daniel; Emerick, Kevin; Gray, Stacey T. (2019). "Tracking operative autonomy and performance in otolaryngology training using smartphone technology: A single institution pilot study." Laryngoscope Investigative Otolaryngology 4(6): 578-586. | |
dc.identifier.issn | 2378-8038 | |
dc.identifier.issn | 2378-8038 | |
dc.identifier.uri | https://hdl.handle.net/2027.42/152965 | |
dc.description.abstract | BackgroundIn the era of duty hour restrictions, otolaryngology residents may not gain the operative experience necessary to function autonomously by the end of training. This study quantifies residents’ autonomy during key indicator cases, defined by the Accreditation Council for Graduate Medical Education.Study DesignProspective cohort study.MethodsFaculty and residents at a large academic institution were surveyed on the surgical autonomy trainees should achieve for otolaryngology key indicator surgeries at each training level. Residents and faculty used the mobile application “System for Improving and Measuring Procedural Learning” (SIMPL) between December 2017 and July 2018 to log trainees’ operative autonomy during cases on a validated four‐level Zwisch scale, from “show and tell” to “supervision only.”ResultsThe study included 40 participants (23 residents and 17 attendings). The survey response rate was 83%. In surveys, residents overestimated the autonomy PGY5 residents should achieve for parotidectomy, rhinoplasty, thyroid/parathyroidectomy, and airway procedures compared with faculty (P < .05). Using SIMPL, 833 evaluations were logged of which 253 were paired evaluations for key indicator cases. Comparing survey predictions with actual cases logged in SIMPL, residents and faculty overestimated the autonomy achieved by senior trainees performing mastoidectomy (PGY5, P < .05) and ethmoidectomy (PGY4/5, P < .05); both felt that senior residents should operate with between “passive help” and “supervision only” whereas residents actually had “passive help.” Residents overestimated their autonomy during rhinoplasty (PGY5, P = .017) and parotidectomy (PGY5, P = .007) while attendings accurately expected chief residents to have “passive help.”ConclusionsResident surgical autonomy varies across otolaryngology procedures. Multicenter studies are needed to elucidate national trends.Level of Evidence2 | |
dc.publisher | John Wiley & Sons, Inc. | |
dc.subject.other | surgical education | |
dc.subject.other | residency | |
dc.subject.other | operative independence | |
dc.title | Tracking operative autonomy and performance in otolaryngology training using smartphone technology: A single institution pilot study | |
dc.type | Article | |
dc.rights.robots | IndexNoFollow | |
dc.subject.hlbsecondlevel | Otolaryngology | |
dc.subject.hlbtoplevel | Health Sciences | |
dc.description.peerreviewed | Peer Reviewed | |
dc.description.bitstreamurl | https://deepblue.lib.umich.edu/bitstream/2027.42/152965/1/lio2323_am.pdf | |
dc.description.bitstreamurl | https://deepblue.lib.umich.edu/bitstream/2027.42/152965/2/lio2323-sup-0001-Supinfo.pdf | |
dc.description.bitstreamurl | https://deepblue.lib.umich.edu/bitstream/2027.42/152965/3/lio2323.pdf | |
dc.identifier.doi | 10.1002/lio2.323 | |
dc.identifier.source | Laryngoscope Investigative Otolaryngology | |
dc.identifier.citedreference | Meyerson SL, Sternbach JM, Zwischenberger JB, Bender EM. The effect of gender on resident autonomy in the operating room. J Surg Educ. 2017; 74 ( 6 ): e111 ‐ e118. https://doi.org/10.1016/j.jsurg.2017.06.014. | |
dc.identifier.citedreference | Brunworth JD, Sindwani R. Impact of duty hour restrictions on otolaryngology training: divergent resident and faculty perspectives. Laryngoscope. 2006; 116 ( 7 ): 1127 ‐ 1130. https://doi.org/10.1097/01.mlg.0000224348.44616.fb. | |
dc.identifier.citedreference | Puram SV, Kozin ED, Sethi R, et al. Impact of resident surgeons on procedure length based on common pediatric otolaryngology cases. Laryngoscope. 2015; 125 ( 4 ): 991 ‐ 997. https://doi.org/10.1002/lary.24912. | |
dc.identifier.citedreference | Puram SV, Barber SR, Kozin ED, et al. Outcomes following pediatric auditory brainstem implant surgery: early experiences in a North American center. Otolaryngol Head Neck Surg. 2016; 155 ( 1 ): 133 ‐ 138. https://doi.org/10.1177/0194599816637599. | |
dc.identifier.citedreference | Kauvar DS, Braswell A, Brown BD, Harnisch M. Influence of resident and attending surgeon seniority on operative performance in laparoscopic Cholecystectomy. J Surg Res. 2006; 132 ( 2 ): 159 ‐ 163. https://doi.org/10.1016/j.jss.2005.11.578. | |
dc.identifier.citedreference | Bartels DD, McCann ME, Davidson AJ, Polaner DM, Whitlock EL, Bateman BT. Estimating pediatric general anesthesia exposure: quantifying duration and risk. Paediatr Anaesth. 2018; 28 ( 6 ): 520 ‐ 527. https://doi.org/10.1111/pan.13391. | |
dc.identifier.citedreference | Dine CJ, Myers JS. Balancing Supervision and Autonomy: An Ongoing Tension. AHRQ Patient Safety Network. https://psnet.ahrq.gov/perspectives/perspective/116/balancing-supervision-and-autonomy-an-ongoing-tension. Accessed July 14, 2018. | |
dc.identifier.citedreference | Brown DJ, Thompson RE, Bhatti NI. Assessment of operative competency in otolaryngology residency: survey of US Program Directors. Laryngoscope. 2008; 118 ( 10 ): 1761 ‐ 1764. https://doi.org/10.1097/MLG.0b013e31817e2c62. | |
dc.identifier.citedreference | George BC, Teitelbaum EN, Darosa DA, et al. Duration of faculty training needed to ensure reliable or performance ratings. J Surg Educ. 2013; 70 ( 6 ): 703 ‐ 708. https://doi.org/10.1016/j.jsurg.2013.06.015. | |
dc.identifier.citedreference | Review Committee for Otolaryngology ‐ Head and Neck Surgery. Required Minimum Number of Key Indicator Procedures for Graduating Residents. 2018. http://www.acgme.org/Portals/0/PFAssets/ProgramResources/280_Required_Minimum_Number_of_Key_Indicator_Procedures.pdf. Accessed August 11, 2019. | |
dc.identifier.citedreference | Home ‐ PLSC. http://www.procedurallearning.org/. Accessed January 1, 2017. | |
dc.identifier.citedreference | Williams RG, Chen XP, Sanfey H, Markwell SJ, Mellinger JD, Dunnington GL. The measured effect of delay in completing operative performance ratings on clarity and detail of ratings assigned. J Surg Educ. 2014; 71 ( 6 ): e132 ‐ e138. https://doi.org/10.1016/j.jsurg.2014.06.015. | |
dc.identifier.citedreference | DaRosa DA, Zwischenberger JB, Meyerson SL, et al. A theory‐based model for teaching and assessing residents in the operating room. J Surg Educ. 2013; 70 ( 1 ): 24 ‐ 30. https://doi.org/10.1016/j.jsurg.2012.07.007. | |
dc.identifier.citedreference | George BC, Teitelbaum EN, Meyerson SL, et al. Reliability, validity, and feasibility of the Zwisch scale for the assessment of intraoperative performance. J Surg Educ. 2014; 71 ( 6 ): e90 ‐ e96. https://doi.org/10.1016/j.jsurg.2014.06.018. | |
dc.identifier.citedreference | Kerby DS. The simple difference formula: an approach to teaching nonparametric correlation. Compr Psychol. 2014; 3: 11.IT.3.1. https://doi.org/10.2466/11.IT.3.1. | |
dc.identifier.citedreference | Chen JX, Kozin ED, Bohnen JD, et al. Assessments of otolaryngology resident operative experiences using mobile technology: a pilot study. Otolaryngol Head Neck Surg. 2019; In Press. https://doi.org/10.1177/0194599819868165. | |
dc.identifier.citedreference | Gross RD, Sheridan MF, Burgess LP. Endoscopic sinus surgery complications in residency. Laryngoscope. 1997; 107 ( 8 ): 1080 ‐ 1085. https://doi.org/10.1097/00005537-199708000-00014. | |
dc.identifier.citedreference | Moore FD. Ethical problems special to surgery: surgical teaching, surgical innovation, and the surgeon in managed care. Arch Surg. 2000; 135 ( 1 ): 14 ‐ 16. https://doi.org/10.1001/archsurg.135.1.14. | |
dc.identifier.citedreference | Meyerson SL, Teitelbaum EN, George BC, Schuller MC, DaRosa DA, Fryer JP. Defining the autonomy gap: when expectations do not meet reality in the operating room. J Surg Educ. 2014; 71 ( 6 ): e64 ‐ e72. https://doi.org/10.1016/j.jsurg.2014.05.002. | |
dc.identifier.citedreference | George BC, Bohnen JD, Williams RG, et al. Readiness of US general surgery residents for independent practice. Ann Surg. 2017; 266 ( 4 ): 582 ‐ 594. https://doi.org/10.1097/SLA.0000000000002414. | |
dc.identifier.citedreference | Williams RG, Swanson DB, Fryer JP, et al. How many observations are needed to assess a surgical trainee’s state of operative competency? Ann Surg. 2019; 269 (2):377‐382. https://doi.org/10.1097/SLA.0000000000002554. | |
dc.identifier.citedreference | Williams RG, George BC, Meyerson SL, et al. What factors influence attending surgeon decisions about resident autonomy in the operating room? Surgery. 2017; 162 ( 6 ): 1314 ‐ 1319. https://doi.org/10.1016/j.surg.2017.07.028. | |
dc.identifier.citedreference | Tsue TT. Developing the otolaryngology milestones. J Grad Med Educ. 2014; 6 ( 1 suppl 1 ): 162 ‐ 165. https://doi.org/10.4300/JGME-06-01s1-21. | |
dc.identifier.citedreference | Kozin ED, Bohnen JD, George BC, et al. Novel mobile app allows for fast and validated intraoperative assessment of otolaryngology residents. OTO Open. 2017; 1 ( 1 ): 2473974X16685705. https://doi.org/10.1177/2473974X16685705. | |
dc.identifier.citedreference | Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system — rationale and benefits. N Engl J Med. 2012; 366 ( 11 ): 1051 ‐ 1056. https://doi.org/10.1056/NEJMsr1200117. | |
dc.owningcollname | Interdisciplinary and Peer-Reviewed |
Files in this item
Remediation of Harmful Language
The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.
Accessibility
If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.