Show simple item record

Comparison of the Standardized Video Interview and Interview Assessments of Professionalism and Interpersonal Communication Skills in Emergency Medicine

dc.contributor.authorHopson, Laura R.
dc.contributor.authorDorfsman, Michele L.
dc.contributor.authorBranzetti, Jeremy
dc.contributor.authorGisondi, Michael A.
dc.contributor.authorHart, Danielle
dc.contributor.authorJordan, Jaime
dc.contributor.authorCranford, James A.
dc.contributor.authorWilliams, Sarah R.
dc.contributor.authorRegan, Linda
dc.date.accessioned2019-08-09T17:14:04Z
dc.date.availableWITHHELD_12_MONTHS
dc.date.available2019-08-09T17:14:04Z
dc.date.issued2019-07
dc.identifier.citationHopson, Laura R.; Dorfsman, Michele L.; Branzetti, Jeremy; Gisondi, Michael A.; Hart, Danielle; Jordan, Jaime; Cranford, James A.; Williams, Sarah R.; Regan, Linda (2019). "Comparison of the Standardized Video Interview and Interview Assessments of Professionalism and Interpersonal Communication Skills in Emergency Medicine." AEM Education and Training 3(3): 259-268.
dc.identifier.issn2472-5390
dc.identifier.issn2472-5390
dc.identifier.urihttps://hdl.handle.net/2027.42/150548
dc.description.abstractObjectivesThe Association of American Medical Colleges Standardized Video Interview (SVI) was recently added as a component of emergency medicine (EM) residency applications to provide additional information about interpersonal communication skills (ICS) and knowledge of professionalism (PROF) behaviors. Our objective was to ascertain the correlation between the SVI and residency interviewer assessments of PROF and ICS. Secondary objectives included examination of 1) inter‐ and intrainstitutional assessments of ICS and PROF, 2) correlation of SVI scores with rank order list (ROL) positions, and 3) the potential influence of gender on interview day assessments.MethodsWe conducted an observational study using prospectively collected data from seven EM residency programs during 2017 and 2018 using a standardized instrument. Correlations between interview day PROF/ICS scores and the SVI were tested. A one‐way analysis of variance was used to analyze the association of SVI and ROL position. Gender differences were assessed with independent‐groups t‐tests.ResultsA total of 1,264 interview‐day encounters from 773 unique applicants resulted in 4,854 interviews conducted by 151 interviewers. Both PROF and ICS demonstrated a small positive correlation with the SVI score (r = 0.16 and r = 0.17, respectively). ROL position was associated with SVI score (p < 0.001), with mean SVI scores for top‐, middle‐, and bottom‐third applicants being 20.9, 20.5, and 19.8, respectively. No group differences with gender were identified on assessments of PROF or ICS.ConclusionsInterview assessments of PROF and ICS have a small, positive correlation with SVI scores. These residency selection tools may be measuring related, but not redundant, applicant characteristics. We did not identify gender differences in interview assessments.
dc.publisherWiley Periodicals, Inc.
dc.titleComparison of the Standardized Video Interview and Interview Assessments of Professionalism and Interpersonal Communication Skills in Emergency Medicine
dc.typeArticle
dc.rights.robotsIndexNoFollow
dc.subject.hlbsecondlevelEmergency Medicine
dc.subject.hlbtoplevelHealth Sciences
dc.description.peerreviewedPeer Reviewed
dc.description.bitstreamurlhttps://deepblue.lib.umich.edu/bitstream/2027.42/150548/1/aet210346_am.pdf
dc.description.bitstreamurlhttps://deepblue.lib.umich.edu/bitstream/2027.42/150548/2/aet210346.pdf
dc.identifier.doi10.1002/aet2.10346
dc.identifier.sourceAEM Education and Training
dc.identifier.citedreferenceHaurani MJ, Rubinfeld I, Rao S, et al. Are the communication and professionalism competencies the new critical values in a resident’s global evaluation process? J Surg Educ 2007; 64: 351 – 6.
dc.identifier.citedreferencePapadakis M, Arnold G, Blank L, et al. Performance during internal medicine residency training and subsequent disciplinary action by state licensing boards. Ann Intern Med 2008; 148: 869 – 76.
dc.identifier.citedreferenceVukmir RB. Medical malpractice: managing the risk. Med Law 2004; 23: 495 – 513.
dc.identifier.citedreferenceJoint Commission Center for Transforming Healthcare Releases Targeted Solutions Tool for Hand‐Off Communications. Joint Commission Perspectives ®, August 2012, Volume 32, Issue 8.
dc.identifier.citedreferencePanagioti M, Geraghty K, Johnson J, et al. Association between physician burnout and patient safety, professionalism, and patient satisfaction: a systematic review and meta‐analysis. JAMA Intern Med 2018; 178: 1317 – 30.
dc.identifier.citedreferenceBird SD, Blomkalns A, Deiorio NM, Gallhue FE. Beyond test scores and medical knowledge: the Standardized Video Interview, an innovative and ethical approach for holistic assessment of applicants. Acad Med 2018; 93: 151.
dc.identifier.citedreferenceThe AAMC Standardized Video Interview: Essentials for the ERAS ® 2019 Season. Available at: https://aamc-orange.global.ssl.fastly.net/production/media/filer_public/75/19/75198c9f-29d1-4884-b932-1e7975e4262a/standardized-video-interview-essentials-eras-2019-20180720.pdf. Accessed October 27, 2018.
dc.identifier.citedreferenceBuckley RJ, Hoch VC, Huang RD. Lights, camera, empathy: a request to slow the emergency medicine Standardized Video Interview project study. AEM Educ Train 2018; 2: 57 – 60.
dc.identifier.citedreferenceDayal A, O’Connor DM, Qadri U, Arora VM. Comparison of male vs female resident milestone evaluations by faculty during emergency medicine residency training. JAMA Intern Med 2017; 177: 651 – 7.
dc.identifier.citedreferenceLi S, Fant AL, McCarthy DM, Miller D, Craig J, Kontrick A. Gender differences in language of standardized letter of evaluation narratives for emergency medicine residency applicants. AEM Educ Train 2017; 1: 334 – 9.
dc.identifier.citedreferenceIsaac C, Chertoff J, Lee B, Carnes M. Do students’ and authors’ genders affect evaluations? A linguistic analysis of medical student performance evaluations. Acad Med 2011; 86: 59 – 66.
dc.identifier.citedreferenceACGME Emergency Medicine Milestone Project. Available at: https://www.acgme.org/Portals/0/PDFs/Milestones/EmergencyMedicineMilestones.pdf. Accessed February 25, 2019.
dc.identifier.citedreferenceSummary of AAMC ® Standardized Video Interview TM Total Scores. Available at: https://aamc-orange.global.ssl.fastly.net/production/media/filer_public/5c/47/5c4790d6-e44f-43a0-8548-92e18243fb74/svi-scorereport-percentileranks-2017-2018.pdf. Accessed November 17, 2018
dc.identifier.citedreferenceSchnapp BH, Ritter D, Kraut AS, Fallon S, Westergaard MC. Assessing residency applicants’ communication and professionalism: Standardized Video Interview scores compared to faculty gestalt. West J Emerg Med 2019; 20: 132 – 7.
dc.identifier.citedreferenceNational Resident Matching Program, Data Release and Research Committee: Results of the 2018 NRMP Program Director Survey. Available at: https://www.nrmp.org/wp-content/uploads/2018/07/NRMP-2018-Program-Director-Survey-for-WWW.pdf. Accessed October 26, 2018.
dc.identifier.citedreferenceBreyer MJ, Sadosty A, Biros M. Factors affecting candidate placement on an emergency medicine residency program’s rank order list. West J Emerg Med 2012; 13: 458 – 62.
dc.identifier.citedreferenceAAMC Standardized Video Interview Update. Association of Academic Chairs in Emergency Medicine. March 13, 2018. Available at: http://saem.org/docs/default-source/joint-retreat/2018/aacem-svi-update.pdf?sfvrsn=599935fd_2. Accessed November 17, 2018.
dc.identifier.citedreferenceBullock AD, Hassell A, Markham WA, Wall DW, Whitehouse AB. How ratings vary by staff group in multi‐source feedback assessment of junior doctors. Med Educ 2009; 43: 516 – 20.
dc.identifier.citedreferenceRisucci DA, Tortolania AJ, Ward RJ. Ratings of surgical residents by self, supervisors and peers. Surg Gynecol Obstet 1989; 169: 519 – 26.
dc.identifier.citedreferenceShay SB. The assessment of complex performance: a socially situated interpretative act. Harv Educ Rev 2004; 74: 307 – 29.
dc.identifier.citedreferenceGovaerts MJ, Schuwirth LW, Van der Vleuten CP, Muijijens AM. Workplace‐based assessment: effects of rater expertise. Adv Health Sci Educ 2011; 16: 151 – 65.
dc.identifier.citedreferenceLance CE, Hoffman BJ, Gentry WA, Baranik LE. Rater source factors represent important subcomponents of the criterion construct space, not rater bias. Hum Resour Manag Rev 2008; 18: 223 – 32.
dc.identifier.citedreferenceCrossley J, Jolly B. Making sense of work‐based assessment: ask the right questions, in the right way, about the right things, of the right people. Med Educ 2012; 46: 28 – 37.
dc.identifier.citedreferenceStephenson‐Famy A, Houmard BS, Oberoi S, Manyak A, Chiang S, Kim S. Use of the interview in resident candidate selection: a review of the literature. J Grad Med Educ 2015; 7: 539 – 48.
dc.identifier.citedreferenceKenny S, McInnes M, Singh V. Associations between residency selection strategies and doctor performance: a meta‐analysis. Med Educ 2013; 47: 790 – 800.
dc.identifier.citedreferenceBhat R, Takenaka K, Levine B, et al. Predictors of a top performer during emergency medicine residency. J Emerg Med 2015; 49: 505 – 12.
dc.identifier.citedreferenceACGME Common Program Requirements. Available at: https://acgme.org/Portals/0/PFAssets/ProgramRequirements/CPRs_2017-07-01.pdf. Accessed February 10, 2019.
dc.identifier.citedreferenceDunleavy D, Geiger T, Overton R, Prescott J. Results of the 2016 Program Directors Survey: Current Practices in Residency Selection. Available at: https://members.aamc.org/eweb/upload/Program%20Directors%20Survey%20Report.pdf Accessed October 27, 2018.
dc.identifier.citedreferenceDupras D, Edson R, Halvorsen A, Hopkins RH Jr, McDonald FS. “Problem residents”: prevalence, problems and remediation in the era of core competencies. Am J Med 2012; 125: 421 – 5.
dc.identifier.citedreferenceZbieranowski I, Takahashi S, Verma S, Spadafora SM. Remediation of residents in difficulty: a retrospective 10‐year review of the experience of a postgraduate board of examiners. Acad Med 2013; 88: 111 – 6.
dc.identifier.citedreferenceRegan L, Hexom B, Nazario S, Chinai SA, Visconti A, Sullivan C. Remediation methods for milestones related to interpersonal and communication skills and professionalism. J Grad Med Educ 2016; 8: 18 – 23.
dc.identifier.citedreferenceSilverberg M, Weizberg M, Murano T, Smith JL, Burkhardt JC, Santen SA. What is the prevalence and success of remediation of emergency medicine residents? West J Emerg Med 2015; 16: 839 – 44.
dc.identifier.citedreferencePapadakis M, Hodgson C, Teherani A. Unprofessional behavior in medical school is associated with subsequent disciplinary action by a state medical board. Acad Med 2004; 799: 244 – 9.
dc.identifier.citedreferencePapadakis M, Teherani A, Banach M, et al. Disciplinary action by medical boards and prior behavior in medical school. N Engl J Med 2005; 353: 2673 – 82.
dc.owningcollnameInterdisciplinary and Peer-Reviewed


Files in this item

Show simple item record

Remediation of Harmful Language

The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.

Accessibility

If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.