52/100

Moderate evidence

ProblemPublished recordScienceProblem Space

The Impact of Target Dataset Choice on Machine Learning Prediction of Severe Hail, Wind, and Tornadoes

Truvace record
TRV-2026-2543raw data (JSON)
Version
v1Published
First published
Evidence type
Benchmark or lab evaluation
Sources
1 sourcePeer-reviewed
sha256
1c4557399f41…check it

Abstract Supervised machine learning (ML) methods implicitly assume that their target dataset is error free. For severe weather prediction, point-based observed Storm Data storm reports that have been expanded in space and time are commonly used targets. However, other target datasets could potentially better represent severe weather occurrence, especially for situations requiring more precision. This study analyzes 1-h probabilistic severe weather hazard forecasts made at lead times from 0 to 3 h from random fo…

The problem

In a comparison of random forest models, severe weather forecasts trained on National Weather Service warnings scored notably worse when checked against storm reports than report-trained models checked against warnings.

What this doesn’t fix

Verification results depend on which dataset is used as truth, since the two target datasets have different spatial and temporal climatologies, so neither model clearly outperforms the other overall.

Sources

1 on file
  1. Peer-reviewed2026-09-28

Cite this record

v1

Truvace Impact Record TRV-2026-2543, v1: “The Impact of Target Dataset Choice on Machine Learning Prediction of Severe Hail, Wind, and Tornadoes.” Truvace, 2026-11-12. /record/TRV-2026-2543 (accessed on the day you copy it). sha256 1c4557399f410bc5…

Change history

1 version

Every change made to this record since it was first published, and why. Nothing has changed since it went up.

  1. Publishedv11c4557399f41…

    Certified into the record

Check this record hasn’t been altered

Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-2543 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.