On the Reliability of Meta-Analytic Reviews
dc.contributor.author | Yeaton, William H. | en_US |
dc.contributor.author | Wortman, Paul M. | en_US |
dc.date.accessioned | 2010-04-13T19:51:44Z | |
dc.date.available | 2010-04-13T19:51:44Z | |
dc.date.issued | 1993 | en_US |
dc.identifier.citation | Yeaton, William; Wortman, Paul (1993). "On the Reliability of Meta-Analytic Reviews." Evaluation Review 17(3): 292-309. <http://hdl.handle.net/2027.42/67840> | en_US |
dc.identifier.issn | 0193-841X | en_US |
dc.identifier.uri | https://hdl.handle.net/2027.42/67840 | |
dc.description.abstract | The article addresses the issue of intercoder reliability in meta-analyses. The current practice of reporting a single, mean intercoder agreement score in meta-analytic research leads to systematic bias and overestimates the true reliability. An alternative approach is recommended in which average intercoder agreement scores or other reliability statistics are calculated within clusters of coded variables. These clusters form a hierarchy in which the correctness of coding decisions at a given level of the hierarchy is contingent on decisions made at higher levels. Two separate studies of intercoder agreement in meta-analysis are presented to assess the validity of the model. | en_US |
dc.format.extent | 3108 bytes | |
dc.format.extent | 905148 bytes | |
dc.format.mimetype | text/plain | |
dc.format.mimetype | application/pdf | |
dc.publisher | Sage Publications | en_US |
dc.title | On the Reliability of Meta-Analytic Reviews | en_US |
dc.type | Article | en_US |
dc.subject.hlbsecondlevel | Public Health | en_US |
dc.subject.hlbtoplevel | Health Sciences | en_US |
dc.description.peerreviewed | Peer Reviewed | en_US |
dc.contributor.affiliationum | University of Michigan | en_US |
dc.contributor.affiliationother | State University of New York | en_US |
dc.description.bitstreamurl | http://deepblue.lib.umich.edu/bitstream/2027.42/67840/2/10.1177_0193841X9301700303.pdf | |
dc.identifier.doi | 10.1177/0193841X9301700303 | en_US |
dc.identifier.source | Evaluation Review | en_US |
dc.identifier.citedreference | Bangert-Drowns, R.L. 1986. Review of developments in meta-analytic method. Psychological Bulletin 99:388-99. | en_US |
dc.identifier.citedreference | Bullock, R.J., and D.J. Svyantek. 1985. Analyzing meta-analysis: Potential problems, an unsuccessful replication, and evaluation criteria. Journal of Applied Psychology 70:108-15. | en_US |
dc.identifier.citedreference | Chalmers, T.C., J. Berrier, H.S. Sacks, H. Levin, D. Reitman, and R. Nagalingham. 1987. Meta-analysis of clinical trials as a scientific discipline. II. Replicate variability and comparison of studies that agree and disagree. Statistics in Medicine 6:733-44. | en_US |
dc.identifier.citedreference | Cooper, H.M. 1982. Scientific guidelines for conducting integrative research reviews. Review of Educational Research 52:291-302. | en_US |
dc.identifier.citedreference | Dooley, D. 1990. Social research methods. 2d ed. Englewood Cliffs, NJ: Prentice-Hall. | en_US |
dc.identifier.citedreference | Dyken, M.L., and R. Pokras. 1984. The performance of endarterectomy for disease of the extracranial arteries of the head. Stroke 15:948-50. | en_US |
dc.identifier.citedreference | Edwards, A.L. 1976. An introduction to linear regression and correlation. San Francisco: Freeman. | en_US |
dc.identifier.citedreference | Ganong, L.H. 1987. Integrative reviews of nursing research. Research in Nursing and Health 10:1-11. | en_US |
dc.identifier.citedreference | Glass, G.V., B. Mc Gaw, and M.L. Smith. 1981. Meta-analysis in social research. Beverly Hills, CA: Sage. | en_US |
dc.identifier.citedreference | Hedges, L.V., and I. Olkin. 1985. Statistical methods for meta-analysis. New York: Academic Press. | en_US |
dc.identifier.citedreference | Holt, R.R. 1982. Occupational stress. In Handbook of stress, edited by L. Goldberg and S. Breznitz. New York: Free Press. | en_US |
dc.identifier.citedreference | Horwitz, R.I., and E.C. Yu. 1984. Assessing the reliability of epidemiologic data obtained from medical records. Journal of Chronic Disease 37:825-31. | en_US |
dc.identifier.citedreference | Hunter, J.E., and F.L. Schmidt. 1990. Methods of meta-analysis. Beverly Hills, CA: Sage. | en_US |
dc.identifier.citedreference | Hunter, J.E., F.L. Schmidt, and G.B. Jackson. 1982. Meta-analysis: Cumulating research findings across studies. Beverly Hills, CA: Sage. | en_US |
dc.identifier.citedreference | Judd, C.M., E.R. Smith, and L.H. Kidder 1991. Research methods in social relations. 6th ed. Fort Worth, TX: Holt, Rinehart & Winston. | en_US |
dc.identifier.citedreference | Kaylor, J.A., D.W. King, and L.A. King. 1987. Psychological effects of military service in Vietnam: A meta-analysis. Psychological Bulletin 102:257-71. | en_US |
dc.identifier.citedreference | Landman, J., and R. Dawes. 1982. Psychotherapy outcome: Smith and Glass' conclusions stand up under scrutiny. American Psychologist 37:504-16. | en_US |
dc.identifier.citedreference | Langenbrunner, J. 1990. Quantitative synthesis methods: Scientific validity and utility for policy. A case study of carotid endarterectomy. Unpublished doctoral dissertation, University of Michigan. | en_US |
dc.identifier.citedreference | Light, R. J. (ed.) 1983. Evaluation studies review annual, Vol. 8. Beverly Hills, CA: Sage. | en_US |
dc.identifier.citedreference | Mandler, G. 1967. Organization and memory. In The psychology of learning and motivation: Advances in research and theory, Vol. 1, edited by K. W. Spence and J. T. Spence, 327-72. New York: Academic Press. | en_US |
dc.identifier.citedreference | Matt, G.E. 1989. Decision rules for selecting effect sizes in meta-analysis: A review and reanalysis of psychotherapy outcome studies. Psychological Bulletin 105:106-15. | en_US |
dc.identifier.citedreference | Orwin, R.G., and D.S. Cordray. 1985. Effects of deficient reporting on meta-analysis: A conceptual framework and reanalysis. Psychological Bulletin 97:134-47. | en_US |
dc.identifier.citedreference | Sacks, H.S., J. Berrier, D. Reitman, V.A. Ancona-Berk, and T.C. Chalmers. 1987. Meta-analyses of randomized controlled trials. New England Journal of Medicine, 316:450-55. | en_US |
dc.identifier.citedreference | Smith, M.L., and G.V. Glass. 1977. Meta-analysis of psychotherapy outcome studies. American Psychologist 32:752-60. | en_US |
dc.identifier.citedreference | Smith, M.L., G.V. Glass, and T.I. Miller. 1980. Benefits ofpsychotherapy. Baltimore, MD: Johns Hopkins University Press. | en_US |
dc.identifier.citedreference | Stock, W.A., M.A. Okun, M.J. Haring, W. Miller, C. Kinney, and R.W. Ceurvorst. 1982. Rigor in data synthesis: A case study in reliability in meta-analysis. Educational Researcher 11:10-14, 20. | en_US |
dc.identifier.citedreference | Susanto, Y.E., W.H. Yeaton, and P.M. Wortman 1990. Multilevel-multifacet meta-analysis: Occupational stress in health care workers. Unpublished manuscript. | en_US |
dc.identifier.citedreference | Von Alven, W.H. 1964. Reliability engineering. Englewood Cliffs, NJ: Prentice Hall. | en_US |
dc.identifier.citedreference | Warlow, C. 1984. Carotid endarteredomy: Does it work? Stroke 15:1068-76. | en_US |
dc.identifier.citedreference | Wortman, P.M. 1983 Evaluation research: A methodological perspective. Annual Review of Psychology 34:223-60. | en_US |
dc.identifier.citedreference | —. 1987. Meta-analysis. New England Journal of Medicine 317:575-76. | en_US |
dc.identifier.citedreference | Wortman, P.M., and L.D. Greenberg. 1971. Coding, recoding, and decoding of hierarchical information in long-term memory. Journal of Verbal Learning and Verbal Behavior 10: 234-43. | en_US |
dc.identifier.citedreference | Yeaton, W.H., and P.M. Wortman. 1984. Evaluation issues in medical research systhesis. New Directions for Program Evaluation 24:43-56. | en_US |
dc.owningcollname | Interdisciplinary and Peer-Reviewed |
Files in this item
Remediation of Harmful Language
The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.
Accessibility
If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.