Probing the Skill of Random Forest Emulators for Physical Parameterizations Via a Hierarchy of Simple CAM6 Configurations
Limon, Garrett C.; Jablonowski, Christiane
2023-06
View/ Open
Citation
Limon, Garrett C.; Jablonowski, Christiane (2023). "Probing the Skill of Random Forest Emulators for Physical Parameterizations Via a Hierarchy of Simple CAM6 Configurations." Journal of Advances in Modeling Earth Systems 15(6): n/a-n/a.
Abstract
Machine learning approaches, such as random forests (RF), have been used to effectively emulate various aspects of climate and weather models in recent years. The limitations to these approaches are not yet known, particularly with regards to varying complexity of the underlying physical parameterization scheme within the climate model. Utilizing a hierarchy of model configurations, we explore the limits of random forest emulator skill using simplified model frameworks within NCAR’s Community Atmosphere Model, version 6 (CAM6). These include a dry CAM6 configuration, a moist extension of the dry model, and an extension of the moist case that includes an additional convection scheme. Each model configuration is run with identical resolution and over the same time period. With unique RF being optimized for each tendency or precipitation rate across the hierarchy, we create a variety of “best case” emulators. The random forest emulators are then evaluated against the CAM6 output as well as a baseline neural network emulator for completeness. All emulators show significant skill when compared to the “truth” (CAM6), often in line with or exceeding similar approaches within the literature. In addition, as the CAM6 complexity is increased, the random forest skill noticeably decreases, regardless of the extensive tuning and training process each random forest goes through. This indicates a limit on the feasibility of RF to act as physics emulators in climate models and encourages further exploration in order to identify ideal uses in the context of state-of-the-art climate model configurations.Plain Language SummaryMachine learning (ML) has become an intriguing technique for replacing complicated aspects of climate and weather models, processes such as cloud interactions and rain are examples of this. However, the limitations of various ML techniques are not yet fully understood. We explore these limits, focusing on a specific ML method and utilizing simplified climate modeling frameworks. The ML models are then carefully analyzed against the original climate model results and results from a standard baseline ML approach. All of our machine learned models show impressive skill at recreating the original results. However, that skill is shown to noticeably decrease as the complexity of the climate model framework is increased. While this may be expected, it is useful for understanding limits on the feasibility of certain ML techniques to be used within state-of-the-art climate models. Further investigation is needed to understand the viability and best use-cases of these methods being adopted into simulating of the Earth system.Key PointsRandom forests (RF) skillfully emulate simple physics schemes within the Community Atmosphere Model in an offline stateHierarchical approach shows both qualitative and quantitative decreases in skill of RF as complexity increasesIn the case of 2-dimensional precipitation fields, random forest skill is in-line with baseline neural network performancePublisher
Cambridge University Press Wiley Periodicals, Inc.
ISSN
1942-2466 1942-2466
Other DOIs
Types
Article
Metadata
Show full item recordCollections
Remediation of Harmful Language
The University of Michigan Library aims to describe library materials in a way that respects the people and communities who create, use, and are represented in our collections. Report harmful or offensive language in catalog records, finding aids, or elsewhere in our collections anonymously through our metadata feedback form. More information at Remediation of Harmful Language.
Accessibility
If you are unable to use this file in its current format, please select the Contact Us link and we can modify it to make it more accessible to you.