Show simple item record

Improving causal inference with a doubly robust estimator that combines propensity score stratification and weighting

dc.contributor.authorLinden, Ariel
dc.date.accessioned2017-08-01T19:08:56Z
dc.date.available2018-09-04T15:09:23Zen
dc.date.issued2017-08
dc.identifier.citationLinden, Ariel (2017). "Improving causal inference with a doubly robust estimator that combines propensity score stratification and weighting." Journal of Evaluation in Clinical Practice 23(4): 697-702.
dc.identifier.issn1356-1294
dc.identifier.issn1365-2753
dc.identifier.urihttps://hdl.handle.net/2027.42/137762
dc.description.abstractRationale, aims and objectivesWhen a randomized controlled trial is not feasible, health researchers typically use observational data and rely on statistical methods to adjust for confounding when estimating treatment effects. These methods generally fall into 3 categories: (1) estimators based on a model for the outcome using conventional regression adjustment; (2) weighted estimators based on the propensity score (ie, a model for the treatment assignment); and (3) “doubly robust” (DR) estimators that model both the outcome and propensity score within the same framework. In this paper, we introduce a new DR estimator that utilizes marginal mean weighting through stratification (MMWS) as the basis for weighted adjustment. This estimator may prove more accurate than treatment effect estimators because MMWS has been shown to be more accurate than other models when the propensity score is misspecified. We therefore compare the performance of this new estimator to other commonly used treatment effects estimators.MethodMonte Carlo simulation is used to compare the DR‐MMWS estimator to regression adjustment, 2 weighted estimators based on the propensity score and 2 other DR methods. To assess performance under varied conditions, we vary the level of misspecification of the propensity score model as well as misspecify the outcome model.ResultsOverall, DR estimators generally outperform methods that model one or the other components (eg, propensity score or outcome). The DR‐MMWS estimator outperforms all other estimators when both the propensity score and outcome models are misspecified and performs equally as well as other DR estimators when only the propensity score is misspecified.ConclusionsHealth researchers should consider using DR‐MMWS as the principal evaluation strategy in observational studies, as this estimator appears to outperform other estimators in its class.
dc.publisherWiley Periodicals, Inc.
dc.publisherMIT Press
dc.subject.otherstratification
dc.subject.othertreatment effects
dc.subject.othercausal inference
dc.subject.otherdoubly robust
dc.subject.otherinverse probability of treatment weights
dc.subject.othermarginal mean weighting through stratification
dc.subject.otherpropensity score
dc.titleImproving causal inference with a doubly robust estimator that combines propensity score stratification and weighting
dc.typeArticleen_US
dc.rights.robotsIndexNoFollow
dc.subject.hlbsecondlevelMedicine (General)
dc.subject.hlbtoplevelHealth Sciences
dc.description.peerreviewedPeer Reviewed
dc.description.bitstreamurlhttps://deepblue.lib.umich.edu/bitstream/2027.42/137762/1/jep12714_am.pdf
dc.description.bitstreamurlhttps://deepblue.lib.umich.edu/bitstream/2027.42/137762/2/jep12714.pdf
dc.identifier.doi10.1111/jep.12714
dc.identifier.sourceJournal of Evaluation in Clinical Practice
dc.identifier.citedreferenceLinden A, Uysal SD, Ryan A, Adams JL. Estimating causal effects for multivalued treatments: a comparison of approaches. Stat Med. 2016; 35 ( 4 ): 534 – 552.
dc.identifier.citedreferenceRosenbaum PR, Rubin DB. Reducing bias in observational studies using subclassification on the propensity score. J Am Stat Assoc. 1984; 79: 516 – 524.
dc.identifier.citedreferenceWooldridge JM. Inverse probability weighted estimation for general missing data problems. J Econ. 2007; 141: 1281 – 1301.
dc.identifier.citedreferenceWooldridge JM. Econometric Analysis of Cross Section and Panel Data. 2nd ed. Cambridge, MA: MIT Press; 2010.
dc.identifier.citedreferenceLinden A, Adams J, Roberts N. Evaluating disease management program effectiveness: an introduction to the bootstrap technique. Dis Manag Health Out. 2005; 13 ( 3 ): 159 – 167.
dc.identifier.citedreferenceLunceford JK, Davidian M. Stratification and weighting via the propensity score in estimation of causal treatment effects: a comparative study. Stat Med. 2004; 23: 2937 – 2960.
dc.identifier.citedreferenceLinden A. MMWS: stata module for implementing mean marginal weighting through stratification. Statistical Software Components s457886, Boston College Department of Economics, 2014. Downloadable from http://ideas.repec.org/c/boc/bocode/s457886.html [Accessed on December 28 2016].
dc.identifier.citedreferenceAustin PC. The performance of different propensity‐score methods for estimating differences in proportions (risk differences or absolute risk reductions) in observational studies. Stat Med. 2010; 29: 2137 – 2148.
dc.identifier.citedreferenceKang JDY, Schafer JL. Demystifying double robustness: a comparison of alternative strategies for estimating a population mean from incomplete data (with comments and rejoinder). Stat Sci. 2007; 22: 523 – 539.
dc.identifier.citedreferenceTan Z. Bounded, efficient and doubly robust estimation with inverse weighting. Biometrika. 2010; 97: 661 – 682.
dc.identifier.citedreferenceRobins JM, Sued M, Lei‐Gomez Q, Rotnitzky A. Comment: performance of double‐robust estimators when “inverse probability” weights are highly variable. Stat Sci. 2007; 22: 544 – 559.
dc.identifier.citedreferenceLinden A, Adams J, Roberts N. Strengthening the case for disease management effectiveness: unhiding the hidden bias. J Eval Clin Pract. 2006; 12: 140 – 147.
dc.identifier.citedreferenceMcCaffrey DF, Ridgeway G, Morral AR. Propensity score estimation with boosted regression for evaluating causal effects in observational studies. Psychol Methods. 2004; 9: 403 – 425.
dc.identifier.citedreferenceSetoguchi S, Schneeweiss S, Brookhart MA, Glynn RJ, Cook EF. Evaluating uses of data mining techniques in propensity score estimation: a simulation study. Pharmacoepidemiol Drug Saf. 2008; 17: 546 – 555.
dc.identifier.citedreferenceLee BK, Lessler J, Stuart EA. Improving propensity score weighting using machine learning. Stat Med. 2010; 29 ( 3 ): 337 – 346.
dc.identifier.citedreferenceWestreich D, Lessler J, Funk MJ. Propensity score estimation: neural networks, support vector machines, decision trees (CART), and meta‐classifiers as alternatives to logistic regression. J Clin Epidemiol. 2010; 63 ( 8 ): 826 – 833.
dc.identifier.citedreferenceNeugebauer R, Schmittdiel JA, van der Laan MJ. A case study of the impact of data‐adaptive versus model‐based estimation of the propensity scores on causal inferences from three inverse probability weighting estimators. Int J Biostat. 2016; 12: 131 – 155.
dc.identifier.citedreferenceLinden A, Yarnold PR. Using data mining techniques to characterize participation in observational studies. J Eval Clin Pract. 2016; 22: 839 – 847.
dc.identifier.citedreferenceLinden A, Roberts N. Disease management interventions: what’s in the black box? Dis Manag. 2004; 7: 275 – 291.
dc.identifier.citedreferenceLinden A, Butterworth S, Roberts N. Disease management interventions II: what else is in the black box? Dis Manag. 2006; 9: 73 – 85.
dc.identifier.citedreferenceWitten IH, Frank E, Hall MA. Data Mining: Practical Machine Learning Tools and Techniques. 3rd ed. San Francisco: Morgan Kaufmann; 2011.
dc.identifier.citedreferenceLinden A, Adams J, Roberts N. The generalizability of disease management program results: getting from here to there. Manag Care Interface. 2004; 17: 38 – 45.
dc.identifier.citedreferenceAngrist JD, Imbens GW, Rubin DB. Identification of causal effects using instrumental variables. J Am Stat Assoc. 1996; 91: 444 – 455.
dc.identifier.citedreferenceLinden A, Adams J. Evaluating disease management program effectiveness: an introduction to instrumental variables. J Eval Clin Pract. 2006; 12: 148 – 154.
dc.identifier.citedreferenceRosenbaum PR, Rubin DB. The central role of propensity score in observational studies for causal effects. Biometrika. 1983; 70: 41 – 55.
dc.identifier.citedreferenceRosenbaum PR. Model‐based direct adjustment. J Am Stat Assoc. 1987; 82: 387 – 394.
dc.identifier.citedreferenceRobins JM, Hernan MA, Brumback B. Marginal structural models and causal inference in epidemiology. Epidemiology. 2000; 11: 550 – 560.
dc.identifier.citedreferenceLinden A, Adams JL. Using propensity score‐based weighting in the evaluation of health management programme effectiveness. J Eval Clin Pract. 2010; 16: 175 – 179.
dc.identifier.citedreferenceLinden A, Adams JL. Evaluating health management programmes over time. Application of propensity score‐based weighting to longitudinal data. J Eval Clin Pract. 2010; 16: 180 – 185.
dc.identifier.citedreferenceLinden A, Adams J, Roberts N. Evaluating disease management program effectiveness: an introduction to survival analysis. Dis Manag. 2004; 7: 180 – 190.
dc.identifier.citedreferenceAustin PC. The performance of different propensity score methods for estimating marginal hazard ratios. Stat Med. 2013; 32: 2837 – 2849.
dc.identifier.citedreferenceRobins JM. Association, causation and marginal structural models. Synthese. 1999; 121: 151 – 179.
dc.identifier.citedreferenceScharfstein DO, Rotnitzky A, Robins JM. Adjusting for non‐ignorable drop‐out using semiparametric non‐response models. J Am Stat Assoc. 1999; 94: 1096 – 1120.
dc.identifier.citedreferenceKurth T, Walker AM, Glynn RJ, et al. Results of multivariable logistic regression, propensity matching, propensity adjustment, and propensity‐based weighting under conditions of nonuniform effect. Am J Epidemiol. 2006; 163: 262 – 270.
dc.identifier.citedreferenceWeitzen S, Lapane KL, Toledano AY, Hume AL, Mor V. Principles for modeling propensity scores in medical research: a systematic literature review. Pharmacoepidemiol Drug Saf. 2004; 13: 841 – 853.
dc.identifier.citedreferenceRobins JM. Robust estimation in sequentially ignorable missing data and causal inference models. Proceedings of the American Statistical Association Section on Bayesian Statistical Science 1999; 6–10.
dc.identifier.citedreferenceRobins JM, Rotnitzky A, Zhao LP. Estimation of regression coefficients when some regressors are not always observed. J Am Stat Assoc. 1994; 89: 846 – 866.
dc.identifier.citedreferenceBang H, Robins JM. Doubly robust estimation in missing data and causal inference models. Biometrics. 2005; 61: 962 – 973.
dc.identifier.citedreferenceHong G. Marginal mean weighting through stratification: adjustment for selection bias in multilevel data. J Educ Behav Stat. 2010; 35: 499 – 531.
dc.identifier.citedreferenceHong G. Marginal mean weighting through stratification: a generalized method for evaluating multi‐valued and multiple treatments with non‐experimental data. Psychol Methods. 2012; 17: 44 – 60.
dc.identifier.citedreferenceLinden A. Combining propensity score‐based stratification and weighting to improve causal inference in the evaluation of health care interventions. J Eval Clin Pract. 2014; 20: 1065 – 1071.
dc.identifier.citedreferenceLinden A. A comparison of approaches for stratifying on the propensity score to reduce bias. J Eval Clin Pract. 2017; 23 ( 4 ): 690 – 696.
dc.identifier.citedreferenceHuang I‐C, Frangakis C, Dominici F, Diette GB, Wu AW. Application of a propensity score approach for risk adjustment in profiling multiple physician groups on asthma care. Health Serv Res. 2005; 40: 253 – 278.
dc.identifier.citedreferenceCochran WG. The effectiveness of adjustment by subclassification in removing bias in observational studies. Biometrics. 1968; 24: 205 – 213.
dc.owningcollnameInterdisciplinary and Peer-Reviewed


Files in this item

Show simple item record

Remediation of Harmful Language

The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.

Accessibility

If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.