The exact text we saved

This is the version exactly as it was saved, character for character. The SHA-256 hash below is a 64-character code worked out from that text. Run the same text through SHA-256 and you get the same code; change a single letter and the code comes out completely different. Each version also stores the previous version’s hash, which chains them together so no version can be swapped out quietly.

TRUVACE RECORD VERSION
record: TRV-2026-2409
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-11-07T06:01:43.592864Z
status: published
lens: trace
sector: health
headline: The impact of temporal resampling on the safety of clinical reinforcement learning: A simulated trial
dek: Author summary Artificial Intelligence (AI) models could help future doctors by recommending personalised treatments for patients. These models are currently trained and tested using historical patient records rather than real patients. Medical decisions happen at unpredictable intervals, but before training an AI model, researchers usually shift and align the timings of recorded decisions into a regular schedule (‘temporal resampling’). This makes training the AI models easier with standard techniques. We inves…
gain_title: In a simulated trial, offline reinforcement learning models trained on unedited, naturally timed insulin data outperformed the simulated clinician baseline, and retrospective safety tests predicted their performance accurately.
problem_title: In a simulated trial with 30 virtual type 1 diabetes patients, resampling decision timings cut AI insulin-dosing performance by up to 60%, and standard retrospective tests predicted 1.5–3x better returns than the models achieved.
trace_subject: Temporal resampling of clinical data for offline reinforcement learning insulin dosing
gain_reading: In a simulated trial, offline reinforcement learning models trained on unedited, naturally timed insulin data outperformed the simulated clinician baseline, and retrospective safety tests predicted their performance accurately.
gain_evidence: These models performed much better and the safety tests accurately predicted their true performance.
problem_reading: In a simulated trial with 30 virtual type 1 diabetes patients, resampling decision timings cut AI insulin-dosing performance by up to 60%, and standard retrospective tests predicted 1.5–3x better returns than the models achieved.
problem_evidence: predicting 1.5–3x better returns than agents achieved in practice
quick_read: A peer-reviewed simulated trial in PLOS Digital Health tested what happens when researchers squeeze irregularly timed clinical decisions into regular time slots before training reinforcement learning models. Using 30 virtual patients with type 1 diabetes from the FDA-approved UVA/Padova simulator, the team found resampling cut model performance by up to 60% relative to models trained on unprocessed data.

With 4-hour binning, an interval commonly used in this research, all three algorithms performed worse than the baseline behaviour in the training data. Standard retrospective evaluation did not catch this: it predicted 1.5–3x better returns than the agents achieved when deployed into the simulated environment.

The concern is that falsely optimistic scores could justify moving weak models into human trials. Models trained on unedited, naturally timed data did much better and their safety checks were accurate. All results come from simulation, so how well they carry over to real patients is untested.
limitation: The simulated environments have simpler observations and random, state-independent decision intervals, which may limit generalisability to complex real clinical settings, and only model-free algorithms were tested.
tag: Dual reading
key_points: In a review of 50 healthcare offline reinforcement learning studies, the authors found 43 used temporally resampled data and only three had been tested in a prospective human trial. | In 12,238 intensive care patients on insulin infusions in the MIMIC-IV database (19,449 episodes), binning reversed the apparent order of glucose measurements and insulin changes for over 70% of paired events. | Binning also masked significant low and high blood sugar events and merged separate insulin adjustment decisions into one. | In the simulator, resampling reduced performance by up to 60%, and models trained on 4-hour bins all performed worse than the dataset's baseline. | Fitted Q-evaluation, the standard retrospective check, overestimated binned-data agents by 1.5–3x but was reasonably calibrated for unprocessed and interpolated data. | Models trained on unprocessed data with irregular timings were the only ones to improve consistently on time in target glucose range and avoid early episode termination. | The authors recommend keeping natural decision intervals and using semi-Markov frameworks that account for them.
rundown: The authors first checked real data. From MIMIC-IV, they extracted 12,238 ICU patients receiving continuous insulin infusions and applied 1-, 2-, 3- and 4-hour bins. More than 70% of reactive glucose-insulin pairs ended up in the same bin, which flips cause and effect, and the share rose as bins widened.

For the trial, they modified the UVA/Padova simulator (10 adults, 10 adolescents and 10 children; 18 for training, 6 for validation, 6 for testing) to use random decision intervals of 1–12 ten-minute steps. A reinforcement learning agent acting as a stand-in clinician generated 10 million transitions, which were kept unprocessed, interpolated or binned.

Behavioural cloning, implicit Q-learning and conservative Q-learning were trained on each version. Performance fell as time abstraction increased: interpolation beat 2-hour binning, which beat 4-hour binning. No model trained on resampled data beat its dataset's baseline, apart from modest gains with implicit Q-learning on interpolated data.

The authors say the optimistic scores arise because binned data contain counterfactual trajectories, so the evaluation predictions amount to hallucinations rather than accurate estimates. Even interpolated models did worse than expected, which they link to compounding errors from distributional shift.
sources:
- journalism | PLOS (Public Library of Science) | https://journals.plos.org/digitalhealth/article?id=10.1371%2Fjournal.pdig.0001801 | 2026-11-06
prev: 0000000000000000000000000000000000000000000000000000000000000000

SHA-256 hash

6f45f47a518c8e5e0ce3db17c420fe66d545ea74713bd7266d4474ca014992ac

Previous version’s hash

0000000000000000000000000000000000000000000000000000000000000000