Show simple item record

Tracking operative autonomy and performance in otolaryngology training using smartphone technology: A single institution pilot study

dc.contributor.authorChen, Jenny X.
dc.contributor.authorKozin, Elliott
dc.contributor.authorBohnen, Jordan
dc.contributor.authorGeorge, Brian
dc.contributor.authorDeschler, Daniel
dc.contributor.authorEmerick, Kevin
dc.contributor.authorGray, Stacey T.
dc.date.accessioned2020-01-13T15:14:11Z
dc.date.availableWITHHELD_12_MONTHS
dc.date.available2020-01-13T15:14:11Z
dc.date.issued2019-12
dc.identifier.citationChen, Jenny X.; Kozin, Elliott; Bohnen, Jordan; George, Brian; Deschler, Daniel; Emerick, Kevin; Gray, Stacey T. (2019). "Tracking operative autonomy and performance in otolaryngology training using smartphone technology: A single institution pilot study." Laryngoscope Investigative Otolaryngology 4(6): 578-586.
dc.identifier.issn2378-8038
dc.identifier.issn2378-8038
dc.identifier.urihttps://hdl.handle.net/2027.42/152965
dc.description.abstractBackgroundIn the era of duty hour restrictions, otolaryngology residents may not gain the operative experience necessary to function autonomously by the end of training. This study quantifies residents’ autonomy during key indicator cases, defined by the Accreditation Council for Graduate Medical Education.Study DesignProspective cohort study.MethodsFaculty and residents at a large academic institution were surveyed on the surgical autonomy trainees should achieve for otolaryngology key indicator surgeries at each training level. Residents and faculty used the mobile application “System for Improving and Measuring Procedural Learning” (SIMPL) between December 2017 and July 2018 to log trainees’ operative autonomy during cases on a validated four‐level Zwisch scale, from “show and tell” to “supervision only.”ResultsThe study included 40 participants (23 residents and 17 attendings). The survey response rate was 83%. In surveys, residents overestimated the autonomy PGY5 residents should achieve for parotidectomy, rhinoplasty, thyroid/parathyroidectomy, and airway procedures compared with faculty (P < .05). Using SIMPL, 833 evaluations were logged of which 253 were paired evaluations for key indicator cases. Comparing survey predictions with actual cases logged in SIMPL, residents and faculty overestimated the autonomy achieved by senior trainees performing mastoidectomy (PGY5, P < .05) and ethmoidectomy (PGY4/5, P < .05); both felt that senior residents should operate with between “passive help” and “supervision only” whereas residents actually had “passive help.” Residents overestimated their autonomy during rhinoplasty (PGY5, P = .017) and parotidectomy (PGY5, P = .007) while attendings accurately expected chief residents to have “passive help.”ConclusionsResident surgical autonomy varies across otolaryngology procedures. Multicenter studies are needed to elucidate national trends.Level of Evidence2
dc.publisherJohn Wiley & Sons, Inc.
dc.subject.othersurgical education
dc.subject.otherresidency
dc.subject.otheroperative independence
dc.titleTracking operative autonomy and performance in otolaryngology training using smartphone technology: A single institution pilot study
dc.typeArticle
dc.rights.robotsIndexNoFollow
dc.subject.hlbsecondlevelOtolaryngology
dc.subject.hlbtoplevelHealth Sciences
dc.description.peerreviewedPeer Reviewed
dc.description.bitstreamurlhttps://deepblue.lib.umich.edu/bitstream/2027.42/152965/1/lio2323_am.pdf
dc.description.bitstreamurlhttps://deepblue.lib.umich.edu/bitstream/2027.42/152965/2/lio2323-sup-0001-Supinfo.pdf
dc.description.bitstreamurlhttps://deepblue.lib.umich.edu/bitstream/2027.42/152965/3/lio2323.pdf
dc.identifier.doi10.1002/lio2.323
dc.identifier.sourceLaryngoscope Investigative Otolaryngology
dc.identifier.citedreferenceMeyerson SL, Sternbach JM, Zwischenberger JB, Bender EM. The effect of gender on resident autonomy in the operating room. J Surg Educ. 2017; 74 ( 6 ): e111 ‐ e118. https://doi.org/10.1016/j.jsurg.2017.06.014.
dc.identifier.citedreferenceBrunworth JD, Sindwani R. Impact of duty hour restrictions on otolaryngology training: divergent resident and faculty perspectives. Laryngoscope. 2006; 116 ( 7 ): 1127 ‐ 1130. https://doi.org/10.1097/01.mlg.0000224348.44616.fb.
dc.identifier.citedreferencePuram SV, Kozin ED, Sethi R, et al. Impact of resident surgeons on procedure length based on common pediatric otolaryngology cases. Laryngoscope. 2015; 125 ( 4 ): 991 ‐ 997. https://doi.org/10.1002/lary.24912.
dc.identifier.citedreferencePuram SV, Barber SR, Kozin ED, et al. Outcomes following pediatric auditory brainstem implant surgery: early experiences in a North American center. Otolaryngol Head Neck Surg. 2016; 155 ( 1 ): 133 ‐ 138. https://doi.org/10.1177/0194599816637599.
dc.identifier.citedreferenceKauvar DS, Braswell A, Brown BD, Harnisch M. Influence of resident and attending surgeon seniority on operative performance in laparoscopic Cholecystectomy. J Surg Res. 2006; 132 ( 2 ): 159 ‐ 163. https://doi.org/10.1016/j.jss.2005.11.578.
dc.identifier.citedreferenceBartels DD, McCann ME, Davidson AJ, Polaner DM, Whitlock EL, Bateman BT. Estimating pediatric general anesthesia exposure: quantifying duration and risk. Paediatr Anaesth. 2018; 28 ( 6 ): 520 ‐ 527. https://doi.org/10.1111/pan.13391.
dc.identifier.citedreferenceDine CJ, Myers JS. Balancing Supervision and Autonomy: An Ongoing Tension. AHRQ Patient Safety Network. https://psnet.ahrq.gov/perspectives/perspective/116/balancing-supervision-and-autonomy-an-ongoing-tension. Accessed July 14, 2018.
dc.identifier.citedreferenceBrown DJ, Thompson RE, Bhatti NI. Assessment of operative competency in otolaryngology residency: survey of US Program Directors. Laryngoscope. 2008; 118 ( 10 ): 1761 ‐ 1764. https://doi.org/10.1097/MLG.0b013e31817e2c62.
dc.identifier.citedreferenceGeorge BC, Teitelbaum EN, Darosa DA, et al. Duration of faculty training needed to ensure reliable or performance ratings. J Surg Educ. 2013; 70 ( 6 ): 703 ‐ 708. https://doi.org/10.1016/j.jsurg.2013.06.015.
dc.identifier.citedreferenceReview Committee for Otolaryngology ‐ Head and Neck Surgery. Required Minimum Number of Key Indicator Procedures for Graduating Residents. 2018. http://www.acgme.org/Portals/0/PFAssets/ProgramResources/280_Required_Minimum_Number_of_Key_Indicator_Procedures.pdf. Accessed August 11, 2019.
dc.identifier.citedreferenceHome ‐ PLSC. http://www.procedurallearning.org/. Accessed January 1, 2017.
dc.identifier.citedreferenceWilliams RG, Chen XP, Sanfey H, Markwell SJ, Mellinger JD, Dunnington GL. The measured effect of delay in completing operative performance ratings on clarity and detail of ratings assigned. J Surg Educ. 2014; 71 ( 6 ): e132 ‐ e138. https://doi.org/10.1016/j.jsurg.2014.06.015.
dc.identifier.citedreferenceDaRosa DA, Zwischenberger JB, Meyerson SL, et al. A theory‐based model for teaching and assessing residents in the operating room. J Surg Educ. 2013; 70 ( 1 ): 24 ‐ 30. https://doi.org/10.1016/j.jsurg.2012.07.007.
dc.identifier.citedreferenceGeorge BC, Teitelbaum EN, Meyerson SL, et al. Reliability, validity, and feasibility of the Zwisch scale for the assessment of intraoperative performance. J Surg Educ. 2014; 71 ( 6 ): e90 ‐ e96. https://doi.org/10.1016/j.jsurg.2014.06.018.
dc.identifier.citedreferenceKerby DS. The simple difference formula: an approach to teaching nonparametric correlation. Compr Psychol. 2014; 3: 11.IT.3.1. https://doi.org/10.2466/11.IT.3.1.
dc.identifier.citedreferenceChen JX, Kozin ED, Bohnen JD, et al. Assessments of otolaryngology resident operative experiences using mobile technology: a pilot study. Otolaryngol Head Neck Surg. 2019; In Press. https://doi.org/10.1177/0194599819868165.
dc.identifier.citedreferenceGross RD, Sheridan MF, Burgess LP. Endoscopic sinus surgery complications in residency. Laryngoscope. 1997; 107 ( 8 ): 1080 ‐ 1085. https://doi.org/10.1097/00005537-199708000-00014.
dc.identifier.citedreferenceMoore FD. Ethical problems special to surgery: surgical teaching, surgical innovation, and the surgeon in managed care. Arch Surg. 2000; 135 ( 1 ): 14 ‐ 16. https://doi.org/10.1001/archsurg.135.1.14.
dc.identifier.citedreferenceMeyerson SL, Teitelbaum EN, George BC, Schuller MC, DaRosa DA, Fryer JP. Defining the autonomy gap: when expectations do not meet reality in the operating room. J Surg Educ. 2014; 71 ( 6 ): e64 ‐ e72. https://doi.org/10.1016/j.jsurg.2014.05.002.
dc.identifier.citedreferenceGeorge BC, Bohnen JD, Williams RG, et al. Readiness of US general surgery residents for independent practice. Ann Surg. 2017; 266 ( 4 ): 582 ‐ 594. https://doi.org/10.1097/SLA.0000000000002414.
dc.identifier.citedreferenceWilliams RG, Swanson DB, Fryer JP, et al. How many observations are needed to assess a surgical trainee’s state of operative competency? Ann Surg. 2019; 269 (2):377‐382. https://doi.org/10.1097/SLA.0000000000002554.
dc.identifier.citedreferenceWilliams RG, George BC, Meyerson SL, et al. What factors influence attending surgeon decisions about resident autonomy in the operating room? Surgery. 2017; 162 ( 6 ): 1314 ‐ 1319. https://doi.org/10.1016/j.surg.2017.07.028.
dc.identifier.citedreferenceTsue TT. Developing the otolaryngology milestones. J Grad Med Educ. 2014; 6 ( 1 suppl 1 ): 162 ‐ 165. https://doi.org/10.4300/JGME-06-01s1-21.
dc.identifier.citedreferenceKozin ED, Bohnen JD, George BC, et al. Novel mobile app allows for fast and validated intraoperative assessment of otolaryngology residents. OTO Open. 2017; 1 ( 1 ): 2473974X16685705. https://doi.org/10.1177/2473974X16685705.
dc.identifier.citedreferenceNasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system — rationale and benefits. N Engl J Med. 2012; 366 ( 11 ): 1051 ‐ 1056. https://doi.org/10.1056/NEJMsr1200117.
dc.owningcollnameInterdisciplinary and Peer-Reviewed


Files in this item

Show simple item record

Remediation of Harmful Language

The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.

Accessibility

If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.