Canonical text (the exact bytes fingerprinted)

TRUVACE RECORD VERSION
record: TRV-2026-1636
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-10-17T01:09:15.163663Z
status: published
lens: g_space
sector: health
headline: Metastasis Extraction From Non-Small Cell Lung Cancer Clinical Notes Using Large Language Model-Based Classification: Retrospective Comparative Study
dek: Background: Identification of metastasis status in non-small cell lung cancer (NSCLC) is a critical part of understanding disease prognosis, treatment courses, trial eligibility, and population-level cancer surveillance. However, metastasis status is inconsistently recorded in structured cancer registry fields, since manual abstraction of clinical notes is often an error-prone process. This challenge highlights an opportunity for leveraging large language models (LLMs) to conduct high-scale metastasis extraction…
gain_title: LLMs classified metastasis from clinical notes with fairly high accuracy and recovered plausible labels for patients with missing registry fields, which could complement cancer registries.
problem_title: (none)
trace_subject: (none)
gain_reading: LLMs classified metastasis from clinical notes with fairly high accuracy and recovered plausible labels for patients with missing registry fields, which could complement cancer registries.
gain_evidence: model predictions agreed with manual annotations at an accuracy of 0.90 and F1-score of 0.89 | More than half (675/1260, 54%) of initially identified cohort 1 patients had missing or unknown registry metastasis labels
problem_reading: (none)
problem_evidence: (none)
quick_read: Researchers at the Winship Cancer Institute compared three language models on two tasks: detecting metastasis at any site and detecting brain or central nervous system metastasis in notes from non-small cell lung cancer patients. They tested a fine-tuned GatorTron encoder alongside zero-shot MedGemma-27B-text and Llama 3.1-70B, using one cohort with registry labels and another with manual annotations.

Metastasis status matters for prognosis, treatment and trial eligibility, yet registries often record it inconsistently, so automated extraction could fill gaps in cancer surveillance. The evidence is retrospective and comes from one institution, and the manually annotated cohort is very small. The recovery analysis was exploratory, so real-world reliability remains to be confirmed.
limitation: The fine-tuned encoder may have been limited by inaccuracies in the registry reference standards used for training, and the manually annotated cohort contained only 22 patients.
tag: Evidence-backed gain
key_points: MedGemma performed best on overall metastasis, with F1 of 0.80 in cohort 1 and 1.0 at patient level in cohort 2. | Llama 3.1-70B performed best on brain/CNS metastasis, with F1 of 0.79 in cohort 1 and 0.93 at patient level in cohort 2. | Site-specific classification by MedGemma reached F1 of 0.82 for liver and 0.79 for bone metastasis. | Error analysis tied several errors to incomplete registry labels, ambiguous clinical language or missing documentation.
rundown: Cohort 1 covered 579 patients and 24,887 notes across 69 note types from 2023 to 2025, using registry-linked metastasis fields as the reference standard. Cohort 2 covered 22 patients and 644 radiology notes from 2010 to 2021, drawn from two completed randomized trials, with dual-annotated labels.

A separate group of 675 patients with missing registry labels was used for an exploratory missingness-recovery analysis, validated against annotations of a random subsample. The best-performing model was also applied to site-specific metastasis classification.

The authors reported that zero-shot generative models handled nuanced documentation and context-dependent brain/CNS metastasis better. The fine-tuned encoder had strong performance, with F1 of 0.72 for overall metastasis in cohort 1.
sources:
- peer_reviewed | JMIR Cancer | https://doi.org/10.2196/99573 | 2026-10-16
prev: 0000000000000000000000000000000000000000000000000000000000000000

sha256

4033327aa1d2eb7eb2be1664ec9f719d8045d1b0ca842a3ccb5e76faefc98575

previous

0000000000000000000000000000000000000000000000000000000000000000