aceModerate evidence
More
Study finds AI storm forecasts beat standard methods out to 8 days
Study title: Evaluating the Skill of Medium-Range Machine Learning–Based Convective Hazard Forecasts Derived from Convection-Allowing Ensembles
- Evidence type
- Controlled or validated comparison
- Sources
- 1 sourcePeer-reviewed
- Published
- 2 min read
- Truvace record
- TRV-2026-2601cite or check it
Study title: Evaluating the Skill of Medium-Range Machine Learning–Based Convective Hazard Forecasts Derived from Convection-Allowing Ensembles
Researchers tested machine learning forecasts of tornadoes, hail and convective wind gusts across the continental US, built from two experimental convection-allowing ensemble systems that ran in real time during spring 2023 and 2024. Neural networks were trained on ensemble output and observed storm reports. The ML hazard forecasts outperformed both updraft-helicity forecasts and climatology through day 8.
Read the study abstract
Abstract We assess the skill of daily machine learning (ML)-based probabilistic convective hazard predictions generated from two experimental medium-range (i.e., extending to day 8) convection-allowing ensemble (CAE) systems to determine if such predictions are skillful over the CONUS. CAE forecasts were generated in real time for events in spring 2023 and 2024, and convective hazard predictions were produced using neural networks, trained with CAE output and observed storm reports (i.e., reports of tornadoes, h…
The gain
In a study of real-time forecasts from spring 2023 and 2024 over the continental US, machine learning hazard forecasts built from convection-allowing ensembles outperformed both updraft-helicity forecasts and climatology through day 8.
In brief
Against ML forecasts built from NOAA's operational Global Ensemble Forecast System (GEFS), the convection-allowing versions were skillful for days 1 to 4. Beyond that, differences were small and not statistically significant, so the extra benefit is limited to the first few days.
All forecasts did better in spring 2024 than in spring 2023, likely because stronger large-scale forcing made storms more predictable. That stronger forcing shrank the advantage over GEFS: the benefit reached days 3 to 4 in 2024 but extended through day 5 in 2023.
Main points
- Forecasts covered the continental US and extended to day 8, longer than the day or two typical of the most advanced storm-scale models.
- Two experimental convection-allowing ensemble systems ran in real time for spring 2023 and 2024 events.
- Neural networks were trained on ensemble output and observed reports of tornadoes, hail and convective wind gusts.
- The ML forecasts beat both updraft-helicity forecasts and climatology through day 8.
- Against GEFS-based ML forecasts, the ensemble-based forecasts were skillful for days 1 to 4; later differences were not statistically significant.
- Spring 2024 forecasts were more skillful than spring 2023, likely due to stronger large-scale forcing.
- Interpretability tests found storm-scale predictors weighted more for days 1 to 2 and environmental predictors for days 3 to 5.
The full story
The work asks whether storm-scale ensemble forecasts, usually limited to a day or two ahead, can guide forecasters at longer lead times. Researchers generated real-time ensemble forecasts in spring 2023 and 2024 and used neural networks to turn them into probabilities of tornadoes, hail and convectively induced wind gusts.
Skill was measured against climatology, updraft-helicity forecasts from the same ensembles, and ML forecasts from NOAA's operational GEFS. The ensemble-based ML forecasts beat climatology and updraft helicity through day 8, and beat GEFS-based forecasts on days 1 to 4.
Year-to-year weather regimes affected the comparisons. Stronger large-scale forcing in 2024 improved all forecasts but reduced the ensemble advantage over GEFS, which extended to days 3 to 4 in 2024 and through day 5 in 2023. The authors say this matters when comparing weather prediction systems.
Interpretability experiments showed the networks relied more on storm-scale predictors for days 1 to 2 and on environmental predictors for days 3 to 5.
Sources
1 on file- Weather and Forecastingdoi:10.1175/waf-d-25-0243.1
Talk it over
Who gets this benefit, and who was left out of the study or story?
Study finds AI storm forecasts beat standard methods out to 8 dayshttps://truvace.com/item/evaluating-the-skill-of-medium-range-machine-learning-based-convective-hazard-fo
Who gets this benefit, and who was left out of the study or story?
The gain In a study of real-time forecasts from spring 2023 and 2024 over the continental US, machine learning hazard forecasts built from convection-allowing ensembles outperformed both updraft-helicity forecasts and climatology through day 8.
Answer in the threadHow do we know? What can this kind of evidence show, and what can’t it?
The evidence This rests on a controlled comparison, from Weather and Forecasting.
Answer in the threadWhat does it leave open? What else would you want to know before acting on it?
Answer in the threadHave you seen AI used this way where you study, work or live? Did it go the same way?
Answer in the thread
The questions are the same on every record. The details under them are taken from this record as written.
What readers say