When Do Misunderstandings Matter? Evidence From Survey Interviews About Smoking
Schober, Michael F.; Suessbrick, Anna L.; Conrad, Frederick G.
2018-04
View/ Open
Citation
Schober, Michael F.; Suessbrick, Anna L.; Conrad, Frederick G. (2018). "When Do Misunderstandings Matter? Evidence From Survey Interviews About Smoking." Topics in Cognitive Science 10(2): 452-484.
Abstract
This paper examines when conceptual misalignments in dialog lead to consequential miscommunication. Two studies explore misunderstanding in survey interviews of the sort conducted by governments and social scientists, where mismeasurement can have real social costs. In 131 interviews about tobacco use, misalignment between respondents’ and researchers’ conceptions of ordinary expressions like “smoking” and “every day” was quantified by probing respondents’ interpretations of survey terms and re‐administering the survey questionnaire with standard definitions after the interview. Respondents’ interpretations were surprisingly variable, and in many cases they did not match the conceptions that researchers intended them to use. More often than one might expect, this conceptual variability was consequential, leading to answers (and, in principle, to estimates of the prevalence of smoking and related attributes in the population) that would have been different had conceptualizations been aligned; for example, fully 12% of respondents gave a different answer about having smoked 100 cigarettes in their entire life when later given a standard definition. In other cases misaligned interpretations did not lead to miscommunication, in that the differences would not have led to different survey responses. Although clarification of survey terms during the interview sometimes improved conceptual alignment, this was not guaranteed; in this corpus some needed attempts at clarification were never made, some attempts did not succeed, and some seemed to make understanding worse. The findings suggest that conceptual misalignments may be more frequent in ordinary conversation than interlocutors know, and that attempts to detect and clarify them may not always work. They also suggest that at least some unresolved misunderstandings do not matter in the sense that they do not change the outcome of the communication—in this case, the survey estimates.Schober et al. describe two studies on how survey interview respondents misunderstand interview questions. After answering a survey, participants are given standardized definitions of the questions they have just answered. Even apparently simple questions such as “Have you smoked more than 100 cigarettes?” are interpreted very differently by participants. Moreover, clarifying the meaning of the definitions with the interviewer does not always help resolve the miscommunication.Publisher
Wiley Periodicals, Inc. Gower
ISSN
1756-8757 1756-8765
Other DOIs
Types
Article
Metadata
Show full item recordCollections
Remediation of Harmful Language
The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.
Accessibility
If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.