Moderate evidence
Published recordScienceProblem Space
More
The Impact of Target Dataset Choice on Machine Learning Prediction of Severe Hail, Wind, and Tornadoes
- Truvace record
- TRV-2026-2543raw data (JSON)
- Version
- v1Published
- First published
- Evidence type
- Benchmark or lab evaluation
- Sources
- 1 sourcePeer-reviewed
- sha256
- 1c4557399f41…check it
Abstract Supervised machine learning (ML) methods implicitly assume that their target dataset is error free. For severe weather prediction, point-based observed Storm Data storm reports that have been expanded in space and time are commonly used targets. However, other target datasets could potentially better represent severe weather occurrence, especially for situations requiring more precision. This study analyzes 1-h probabilistic severe weather hazard forecasts made at lead times from 0 to 3 h from random fo…
The problem
In a comparison of random forest models, severe weather forecasts trained on National Weather Service warnings scored notably worse when checked against storm reports than report-trained models checked against warnings.
What this doesn’t fix
Verification results depend on which dataset is used as truth, since the two target datasets have different spatial and temporal climatologies, so neither model clearly outperforms the other overall.
Sources
1 on file- Artificial Intelligence for the Earth Systemsdoi:10.1175/aies-d-26-0004.1
Cite this record
v1Truvace Impact Record TRV-2026-2543, v1: “The Impact of Target Dataset Choice on Machine Learning Prediction of Severe Hail, Wind, and Tornadoes.” Truvace, 2026-11-12. /record/TRV-2026-2543 (accessed on the day you copy it). sha256 1c4557399f410bc5…
Change history
1 versionEvery change made to this record since it was first published, and why. Nothing has changed since it went up.
Certified into the record
Check this record hasn’t been altered
How to check it yourself, without trusting this page
Download any version from /api/record/TRV-2026-2543 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.
ace