Search Results

Search Constraints

Start Over
Filtering by: Creator Chen, Yang Remove constraint Creator: Chen, Yang Discipline Science Remove constraint Discipline: Science

Search Results

  • VISTA TEC Database (ver 2.0)

    work
    Creator:
    Sun, Hu, Ren, Jiaen, Chen, Yang, Zou, Shasha, Chang, Yurui, Wang, Zihan, and Coster, Anthea
    Description:
    Our research focuses on providing a fully-imputed map of the worldwide total electron content with high resolution and spatial-temporal smoothness. We fill in the missing values of the original Madrigal TEC maps via estimating the latent feature of each latitude and local time along the 2-D grid and give initial guess of the missing regions based on pre-computed spherical harmonics map. The resulting TEC map has high imputation accuracy and the ease of reproducing. All data are in HDF5 format and are easy to read using the h5py package in Python. The TEC map is grouped in folders based on years and each file contains a single-day data of 5-min cadence. Each individual TEC map is of size 181*361. and WARNING: 2023-12-01 the data file for 2019-Jan-03 has badly fitted values. Please avoid using it. All other days' files are ready to use.
    Keyword:
    Total Electron Content, Matrix Completion, VISTA, Spherical Harmonics, and Spatial-Temporal Smoothing
    Citation to related publication:
    Sun, H., Hua, Z., Ren, J., Zou, S., Sun, Y., & Chen, Y. (2022). Matrix completion methods for the total electron content video reconstruction. The Annals of Applied Statistics, 16(3), 1333-1358., Sun, H., Chen, Y., Zou, S., Ren, J., Chang, Y., Wang, Z., & Coster, A. (2023). Complete Global Total Electron Content Map Dataset based on a Video Imputation Algorithm VISTA. Scientific Data, in press., and Zou, S., Ren, J., Wang, Z., Sun, H., & Chen, Y. (2021). Impact of storm-enhanced density (SED) on ion upflow fluxes during geomagnetic storm. Frontiers in Astronomy and Space Sciences, 8, 746429.
    Discipline:
    Science and Engineering

  • VISTA TEC database

    work
    Creator:
    Sun, Hu, Ren, Jiaen, Chen, Yang, and Zou, Shasha
    Description:
    Our research focuses on providing a fully-imputed map of the worldwide total electron content with high resolution and spatial-temporal smoothness. We fill in the missing values of the original Madrigal TEC maps via estimating the latent feature of each latitude and local time along the 2-D grid and give initial guess of the missing regions based on pre-computed spherical harmonics map. The resulting TEC map has high imputation accuracy and the ease of reproducing. and All data are in HDF5 format and are easy to read using the h5py package in Python. The TEC map is grouped in folders based on years and each file contains a single-day data of 5-min cadence. Each individual TEC map is of size 181*361.
    Keyword:
    Total Electron Content, Matrix Completion, VISTA, Spherical Harmonics, and Spatial-Temporal Smoothing
    Citation to related publication:
    Sun, H., Hua, Z., Ren, J., Zou, S., Sun, Y., & Chen, Y. (2020). Matrix Completion Methods for the Total Electron Content Video Reconstruction. arXiv preprint arXiv:2012.01618. and Zou, S., Ren, J., Wang, Z., Sun, H., & Chen, Y. (2021). Impact of Storm-Enhanced Density (SED) on Ion Upflow Fluxes During Geomagnetic Storm. Frontiers in Astronomy and Space Sciences, 162.
    Discipline:
    Science

  • Data and Data products for machine learning applied to solar flares

    work
    Creator:
    Chen, Yang and Manchester, Ward IV
    Description:
    GOES_flare_list: contains a list of more than 10,000 flare events. The list has 6 columns, flare classification, active region number, date, start time end time, emission peak time, GOES_B_flare_list: contains time series data of SDO/HMI SHARP parameters for B class solar flares , GOES_MX_flare_list: contains time series data of SDO/HMI SHARP parameters for M and X class solar flares, SHARP_B_flare_data_300.hdf5 and SHARP_MX_flare_data_300.hdf5 files contain time series more than 20 physical variables derived from the SDO/HMI SHARP data files. These data are saved at a 12 minute cadence and are used to train the LSTM model., and B_HARPs_CNNencoded_part_xxx.hdf5 and M_X HARPs_CNNencoded_part_xxx.hdf5 include neural network encoded features derived from vector magnetogram images derived from the Solar Dynamics Observatory (SDO) Helioseismic and Magnetic Imager (HMI). These data files typically contains one or two sequences of magnetograms covering an active region for a period of 24h with a 1 hour cadence. We encode each magnetogram with frames of a fixed size of 8x16 with 512 channels.
    Keyword:
    machine learning, data science, and solar flare prediction
    Citation to related publication:
    Chen, Y., Manchester, W., Hero, A., Toth, G., DuFumier, B. Zhou, T., Wang, X., Zhu, H., Sun, Zeyu, Gombosi, T., Identifying Solar Flare Precursors Using Time Series of SDO/HMI Images and SHARP Parameters, Space Weather, 17, 1404–1426.  https://doi.org/10.1029/2019SW002214 and Jiao, Z., Chen, Y., Manchester, W. (2020). Data for Solar Flare Intensity Prediction with Machine Learning Models [Data set]. University of Michigan - Deep Blue.  https://doi.org/10.7302/b07j-bj08
    Discipline:
    Engineering and Science

  • Results for "New Findings from Explainable SYM-H Forecasting using Gradient Boosting Machines"

    work
    Creator:
    Iong, Daniel, Chen, Yang, Toth, Gabor, Zou, Shasha, Pulkkinen, Tuija I., Ren, Jiaen, Camporeale, Enrico, and Gombosi, Tamas I. I.
    Description:
    In this work, we trained gradient boosted trees using XGBoost to predict the SYM-H forecasting using different combinations of solar wind and interplanetary magnetic field (IMF) parameters. Data are in csv and Python pickle formats.
    Keyword:
    SYM-H forecasting
    Citation to related publication:
    Iong, D., Y. Chen, G. Toth, S. Zou, T. I. Pulkkinen, J. Ren, E. Camporeale, and T. I. Gombosi, New Findings from Explainable SYM-H Forecasting using Gradient Boosting Machines, Space Weather,11, accepted, 2022.  https://doi.org/10.1002/essoar.10508063.3
    Discipline:
    Science

  • Data for Solar Flare Intensity Prediction with Machine Learning Models

    work
    Creator:
    Jiao, Zhenbang, Chen, Yang, and Manchester, Ward
    Description:
    GOES_flare_list: contains a list of more than 12,013 flare events. The list has 6 columns, flare classification, active region number, date, start time end time, emission peak time. SHARP_data.hdf5 files contain time series of 20 physical variables derived from the SDO/HMI SHARP data files. These data are saved at a 12 minute cadence and are used to train the LSTM model.
    Keyword:
    Solar Flare Prediction and Machine Learning
    Citation to related publication:
    Jiao, Z., Sun, H., Wang, X., Manchester, W., Gombosi, T., Hero, A., & Chen, Y. (2020). Solar Flare Intensity Prediction With Machine Learning Models. Space Weather, 18(7), e2020SW002440.  https://doi.org/10.1029/2020SW002440 and Chen, Y., & Manchester, W. (2019). Data and Data products for machine learning applied to solar flares [Data set], University of Michigan - Deep Blue.  https://doi.org/10.7302/qnsq-cs38
    Discipline:
    Engineering and Science