TRV-2026-2525Version 1 · Published

Saved · see the current record

Why this version exists

Certified into the record

The exact text we saved

This is the version exactly as it was saved, character for character. The SHA-256 hash below is a 64-character code worked out from that text. Run the same text through SHA-256 and you get the same code; change a single letter and the code comes out completely different. Each version also stores the previous version’s hash, which chains them together so no version can be swapped out quietly.

TRUVACE RECORD VERSION
record: TRV-2026-2525
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-11-12T07:48:16.606102Z
status: published
lens: trace
sector: science
headline: Physics vs. AI in weather prediction: evaluating GraphCast, AIFS, and FuXi against an observation-corrected WRF model for flash floods
dek: Data-driven artificial intelligence (AI) weather models are increasingly positioned as alternatives or complements to physics-based numerical weather prediction (NWP) systems, yet systematic model evaluation studies that compare both paradigms under controlled experimental conditions remain limited. Here we present a structured model evaluation framework applying standardised verification metrics to assess a regional WRF configuration against three publicly available AI models – GraphCast, AIFS Single 1.0, and F…
gain_title: In a hindcast study of three floods in Luxembourg and the Greater Region, AIFS and GraphCast cut temperature error by 19.0% and 17.6% against an observation-corrected physics model and led it on light-rain forecast skill.
problem_title: In the same study, at 20 mm of rain per 6 hours the physics model scored highest (CSI 0.160 against 0.141 for AIFS and 0.114 for GraphCast), and FuXi forecast no such rainfall at all.
trace_subject: AI versus physics-based forecasting of rainfall and temperature in Luxembourg flood events
gain_reading: In a hindcast study of three floods in Luxembourg and the Greater Region, AIFS and GraphCast cut temperature error by 19.0% and 17.6% against an observation-corrected physics model and led it on light-rain forecast skill.
gain_evidence: reduce temperature RMSE by 19.0 % and 17.6 % relative to assimilated WRF | GraphCast the highest net categorical skill (CSI 0.424, against 0.415 for AIFS and 0.389 for the assimilated WRF)
problem_reading: In the same study, at 20 mm of rain per 6 hours the physics model scored highest (CSI 0.160 against 0.141 for AIFS and 0.114 for GraphCast), and FuXi forecast no such rainfall at all.
problem_evidence: at 20 mm (6 h) −1 WRF attains the highest skill (CSI 0.160), ahead of AIFS (0.141) and GraphCast (0.114), while FuXi produces no exceedances at all
quick_read: Researchers at the University of Luxembourg compared three AI weather models (GraphCast, AIFS Single 1.0 and FuXi) with a regional physics-based WRF model that was corrected using observations. They tested all four systems on flood events in 2016, 2018 and 2021, scoring them against 92,119 matched forecast–observation pairs from stations across four countries.

At light rain of 1 mm per 6 hours, GraphCast had the best overall skill (CSI 0.424) and AIFS detected the most rain events (POD 0.835), both ahead of the assimilated WRF (CSI 0.389). AIFS and GraphCast also cut temperature error by 19.0% and 17.6% against assimilated WRF.

The order flipped for heavy rain, which matters most for flash-flood warnings. At 20 mm per 6 hours WRF scored highest (CSI 0.160), ahead of AIFS (0.141) and GraphCast (0.114), and FuXi produced no exceedances. Only three events were tested, and AIFS was fine-tuned on data covering all three, so its scores may be optimistic.
limitation: Only three flood events were tested, and AIFS was fine-tuned on 2016–2022 data covering all of them, so its scores may be optimistic and cannot show generalisation.
tag: Dual reading
key_points: The test covered three floods (July 2016, the 2018 Mullerthal flash flood and the July 2021 European flood), with 345 valid 6-hour times and 259, 280 and 264 independent precipitation stations per event. | Assimilating observations raised WRF's 1 mm CSI from 0.364 to 0.389 and moved temperature bias close to zero, but at 10 mm the assimilated run scored below the unassimilated one (CSI 0.189 against 0.212). | AIFS was best at 5 and 10 mm; at 10 mm its CSI was 0.237 against 0.189 for assimilated WRF. | GraphCast's skill fell from CSI 0.424 at 1 mm to 0.114 at 20 mm, and FuXi produced no 20 mm exceedances anywhere in the verification set. | AIFS had the lowest temperature error (RMSE 1.552 °C) and GraphCast followed (1.580 °C), against 1.916 °C for assimilated WRF; FuXi had the highest errors and a warm bias of +0.609 °C. | GraphCast's skill was highest on the 2021 event (CSI 0.493 against 0.430 in 2016), though that event lies after its 1979–2017 training period. | On one A100 GPU a 6-hour AI forecast took about 1.5 minutes, roughly 140 times faster than the WRF chain on 52 CPU cores (34–37 minutes per cycle). | In a radar comparison over 27 six-hour periods in July 2021, AIFS led at 1 mm, but at 20 mm both WRF configurations were ahead of all three AI models.
rundown: The study ran a Luxembourg-tuned WRF model at 12 km grid spacing with 3D-VAR assimilation of GNSS zenith total delay and conventional observations every 6 hours. It was compared with GraphCast, FuXi and AIFS Single 1.0, all started from the same ERA5 reanalysis and re-initialised every 6 hours. Stations within 12 km of any assimilated surface observation were excluded, and none of the systems received bias correction.

On light rain and temperature the AI models led. GraphCast's CSI was 0.424 at 1 mm, AIFS reached a detection rate of 0.835, and AIFS and GraphCast beat assimilated WRF on temperature RMSE by 0.364 °C and 0.337 °C, differences the bootstrap resolved at every block length tested. Their 1 mm CSI advantage over WRF was +0.035 for GraphCast and +0.026 for AIFS.

Heavy rain reversed the order. WRF's 20 mm CSI of 0.160 beat GraphCast by +0.046, a gap the bootstrap resolved at all block lengths. Its edge over AIFS (+0.019) was resolved only for 24 and 48 hour blocks. Radar checks for July 2021 showed the same reversal in space, with both WRF configurations ahead of the three AI models at 20 mm.

Assimilation itself helped light-rain detection (POD 0.527 to 0.611) but lowered CSI at 5 and 10 mm, and the 10 mm decrease appeared in all three events (largest in 2018, −0.027). In 2018 the assimilated run issued 338 heavy forecasts against 263 but scored 114 hits against 132. The authors report this without attributing a cause.
sources:
- peer_reviewed | Geoscientific Model Development | https://doi.org/10.5194/gmd-19-9831-2026 | 2026-10-13
prev: 0000000000000000000000000000000000000000000000000000000000000000
SHA-256 hash
74a23a0b93edc36159b598814a39b227269cded086c7cc56a11fd8f4dfa2b808
Previous version’s hash
0000000000000000000000000000000000000000000000000000000000000000
Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-2525 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.