Search Constraints
Filtering by:
Creator
Ganushkina, Natalia Y.
Remove constraint Creator: Ganushkina, Natalia Y.
1 - 2 of 2
Number of results to display per page
View results as:
Search Results
-
- Creator:
- Liemohn, Michael W., Ganushkina, Natalia Y., Welling, Daniel T., and Azari, Abigail R.
- Description:
- When we assess a model's ability to predict observed events, there are many equations to choose from, commonly called metrics, that quantify particular aspects of that data-model relationship. One set of such relationships are called skill scores, in which the value from a metric is compared against the same metric but from a different model, a reference model. For assessing event detection, there are several well-known skill scores, all of which are based on a particular reference model. It is shown here that this reference model is not ideal for assessing a new model's skill because it is, unfortunately, based in part on the new model's performance against the data. It is shown that these well-known skill scores have an ambiguous connection to the underlying metric score. Holding the metric value of the new model constant, there is a range of possible skill scores, and conversely, a given skill score value could result from a range of original metric values. It is recommended to stop using these famous skill scores and instead adopt one of several presented alternatives, all of which are fully independent of the new model. All of the plots for this study were created in Excel spreadsheets. The resulting plot files were then combined into the multi-panel figures for the paper using Adobe Illustrator. Specifically, the "xlsx" files were created using Excel Version 16.94 for the Mac and the "txt" files are were generated with Save As -> Tab Delimited Text format.
- Keyword:
- Skill scores, Heidke skill score, Peirce skill score, Gilbert skill score, event detection analysis, and data-model comparison
- Citation to related publication:
- Liemohn, Michael W., Ganushkina, Natalia Yu., Welling, Daniel T., & Azari, Abigail R. (2025). Defining an independent reference model for event detection skill scores. Submitted to AGU Advances, 21 February 2025, manuscript # 2025AV001xxx.
- Discipline:
- Science
-
- Creator:
- Swiger, Brian M., Liemohn, Michael W., and Ganushkina, Natalia Y.
- Description:
- We sampled the near-Earth plasma sheet using data from the NASA Time History of Events and Macroscale Interactions During Substorms mission. For the observations of the plasma sheet, we used corresponding interplanetary observations using the OMNI database. We used these data to develop a data-driven model that predicts plasma sheet electron flux from upstream solar wind variations. The model output data are included in this work, along with code for analyzing the model performance and producing figures used in the related publication. and Data files are included in hdf5 and Python pickle binary formats; scripts included are set up for use of Python 3 to access and process the pickle binary format data.
- Keyword:
- neural network, plasma sheet, solar wind, machine learning, keV electron flux, deep learning, and space weather
- Citation to related publication:
- Swiger, B. M., Liemohn, M. W., & Ganushkina, N. Y. (2020). Improvement of Plasma Sheet Neural Network Accuracy With Inclusion of Physical Information. Frontiers in Astronomy and Space Sciences, 7. https://doi.org/10.3389/fspas.2020.00042
- Discipline:
- Science and Engineering