Our research focuses on providing a fully-imputed map of the worldwide total electron content with high resolution and spatial-temporal smoothness. We fill in the missing values of the original Madrigal TEC maps via estimating the latent feature of each latitude and local time along the 2-D grid and give initial guess of the missing regions based on pre-computed spherical harmonics map. The resulting TEC map has high imputation accuracy and the ease of reproducing.
All data are in HDF5 format and are easy to read using the h5py package in Python. The TEC map is grouped in folders based on years and each file contains a single-day data of 5-min cadence. Each individual TEC map is of size 181*361. and WARNING: 2023-12-01 the data file for 2019-Jan-03 has badly fitted values. Please avoid using it. All other days' files are ready to use.
Sun, H., Hua, Z., Ren, J., Zou, S., Sun, Y., & Chen, Y. (2022). Matrix completion methods for the total electron content video reconstruction. The Annals of Applied Statistics, 16(3), 1333-1358., Sun, H., Chen, Y., Zou, S., Ren, J., Chang, Y., Wang, Z., & Coster, A. (2023). Complete Global Total Electron Content Map Dataset based on a Video Imputation Algorithm VISTA. Scientific Data, in press., and Zou, S., Ren, J., Wang, Z., Sun, H., & Chen, Y. (2021). Impact of storm-enhanced density (SED) on ion upflow fluxes during geomagnetic storm. Frontiers in Astronomy and Space Sciences, 8, 746429.
This research was completed to statistically validate that a data-model refinement technique could integrate real measurements to remove bias from physics-based models via changing the forcing parameters such as the thermal conductivity coefficients.
Ponder, B. M., Ridley, A. J., Goel, A., & Bernstein, D. S. (2023). Improving forecasting ability of GITM using data-driven model refinement. Space Weather, 21, e2022SW003290. https://doi.org/10.1029/2022SW003290
For Drifters, HYCOM, MITgcm: Spectra and kinetic energy files. Please see readme.txt for a description of all data and code contained here. and - Compare kinetic energies (KE) of high-resolution global ocean models estimated from rotary spectra to KE in surface drifter observations.
- Near-inertial KE is closer to drifter observations in models with frequently updated wind forcing
- Internal tide KE is closer to drifter observations in models with topographic wave drag
Elipot, S., Lumpkin, R., Perez, R. C., Lilly, J. M., Early, J. J., & Sykulski, A. M. (2016). A global surface drifter data set at hourly resolution. Journal of Geophysical Research: Oceans, 121(5), 2937–2966. https://doi.org/10.1002/2016JC011716