Machine Learning for Healthcare: Model Development and Implementation in Longitudinal Settings
dc.contributor.author | Otles, Erkin | |
dc.date.accessioned | 2024-05-22T17:28:47Z | |
dc.date.available | 2024-05-22T17:28:47Z | |
dc.date.issued | 2024 | |
dc.date.submitted | 2022 | |
dc.identifier.uri | https://hdl.handle.net/2027.42/193446 | |
dc.description.abstract | Despite great promise, developing and implementing machine learning (ML) models for healthcare remains a challenging engineering task. The progression of disease generates complex longitudinal data that can be difficult to harness when developing models. Additionally, the practice of medicine is inherently dynamic, meaning that implemented models must be responsive to changes. This dissertation aims to address some of these challenges. In the first part, we focus on the issues surrounding the development of models for use in the setting of occupational injuries. This field has typically focused on developing models that predict injured patients’ return to work dates using information collected around the time of their injury. We demonstrate that a reformulated model using longitudinal observations has better predictive performance than a baseline representative of the existing approaches. Parts two and three focus on the implementation of ML models. In the second part, we investigate the phenomena of prospective performance degradation. Although ML models experience degradation over time, the amount of degradation expected and the mechanisms through which degradation occurs are unclear. We introduce methods to formally quantify this degradation. Additionally, we present techniques to isolate the leading causes of this degradation, splitting temporal shift (changes in patients and practice) from information technology (IT) infrastructure shift (differences in the data pipelines serving retrospective model development and prospective implementation). These techniques and ancillary analyses allow model developers to debug models to improve prospective model performance. In the third part, we focus on the problem of updating risk stratification models that have been integrated into clinical practice. Model developers may seek to maintain or improve ML model performance over time. Thus, model developers might update models as part of their regular maintenance. We focus on how updated models may change the risk stratification of patients, leading to poor clinician-model team performance. We propose a new rank-based compatibility measure for assessing risk stratification model updates. In addition to describing the behavior of this measure, we also introduce a technique for model developers to generate updated models that balance high rank-based compatibility against discriminative performance. Altogether, this work provides model developers with methods to analyze and develop updates for risk stratification models that support clinical decision making. | |
dc.language.iso | en_US | |
dc.subject | Machine Learning | |
dc.subject | Artificial Intelligence & Machine Learning for Healthcare & Medicine | |
dc.subject | Risk Prediction Models | |
dc.subject | Model Development & Implementation | |
dc.subject | Dataset Shift | |
dc.subject | Model Updating | |
dc.title | Machine Learning for Healthcare: Model Development and Implementation in Longitudinal Settings | |
dc.type | Thesis | |
dc.description.thesisdegreename | PhD | |
dc.description.thesisdegreediscipline | Industrial & Oper Eng PhD | |
dc.description.thesisdegreegrantor | University of Michigan, Horace H. Rackham School of Graduate Studies | |
dc.contributor.committeemember | Denton, Brian | |
dc.contributor.committeemember | Wiens, Jenna | |
dc.contributor.committeemember | Singh, Karandeep | |
dc.contributor.committeemember | Cohn, Amy Ellen Mainville | |
dc.contributor.committeemember | Guikema, Seth David | |
dc.subject.hlbsecondlevel | Computer Science | |
dc.subject.hlbsecondlevel | Industrial and Operations Engineering | |
dc.subject.hlbsecondlevel | Medicine (General) | |
dc.subject.hlbsecondlevel | Public Health | |
dc.subject.hlbtoplevel | Engineering | |
dc.subject.hlbtoplevel | Health Sciences | |
dc.contributor.affiliationumcampus | Ann Arbor | |
dc.description.bitstreamurl | http://deepblue.lib.umich.edu/bitstream/2027.42/193446/1/eotles_1.pdf | |
dc.identifier.doi | https://dx.doi.org/10.7302/23091 | |
dc.identifier.orcid | 0000-0003-3169-6832 | |
dc.identifier.name-orcid | Otles, Erkin; 0000-0003-3169-6832 | en_US |
dc.working.doi | 10.7302/23091 | en |
dc.owningcollname | Dissertations and Theses (Ph.D. and Master's) |
Files in this item
Remediation of Harmful Language
The University of Michigan Library aims to describe its collections in a way that respects the people and communities who create, use, and are represented in them. We encourage you to Contact Us anonymously if you encounter harmful or problematic language in catalog records or finding aids. More information about our policies and practices is available at Remediation of Harmful Language.
Accessibility
If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.