Truace
Subscribe

Multi-task deep learning integrating pretreatment MRI and whole slide images predicts induction chemotherapy response and survival in locally advanced nasopharyngeal carcinoma

Predicting response to induction chemotherapy (IC) and overall survival (OS) is critical for optimizing treatment in patients with locally advanced nasopharyngeal carcinoma (LANPC). This study aimed to develop and validate a multi-task deep learning model integrating pretreatment MRI and whole slide images (WSIs) to predict IC response and OS in LANPC. Pretreatment MRI and WSIs from 404 patients with LANPC were retrospectively collected to construct a multi-task model (MoEMIL) for the simultaneous prediction of…

By the Truvace desk2 min read1 sourcePeer-reviewedTRV-2026-1865· cite & verify
Multi-task deep learning integrating pretreatment MRI and whole slide images predicts induction chemotherapy response and survival in locally advanced nasopharyngeal carcinoma
"Capillaritis-Acute hemorrhage - Milk allergy Case 107" by Pulmonary Pathology is licensed under CC BY-SA 2.0. To view a copy of this license, visit https://creativecommons.org/licenses/by-sa/2.0/.

In brief

Researchers built a multi-task deep learning system called MoEMIL that reads pretreatment MRI scans and whole slide pathology images from patients with locally advanced nasopharyngeal carcinoma. It predicts early response to induction chemotherapy and overall survival at the same time.

The work points toward earlier, more individualized treatment planning, because response and prognosis could be estimated before therapy begins. The authors describe it only as a possible adjunct tool, and the evidence comes from retrospective data, so its value in actual clinical decisions has not been shown.

Main points

  1. The study used pretreatment MRI and whole slide images from 404 retrospectively collected patients with locally advanced nasopharyngeal carcinoma.
  2. Whole slide images were processed with multi-instance learning, while MRI features came from PyRadiomics and a ResNet50 network, fused through a multi-gate mixture-of-experts design.
  3. Areas under the curve for IC response were 0.917, 0.869, and 0.801 in the train, validation, and test sets.
  4. The model split patients into high- and low-risk overall survival groups (P < 0.05).

The gain

A model combining pretreatment MRI and pathology slides separated good from poor induction chemotherapy responders and outperformed TNM staging on both response and survival prediction in a test set.

The rundown

The model, MoEMIL, takes two data types: radiology features from MRI and histopathology features from digitized tissue slides. A multi-gate mixture-of-experts architecture fuses them so one network handles both response and survival prediction.

In the test set it significantly outperformed a deep learning radiomics model and TNM staging on both endpoints. Against a pathomics-only model, it showed a significant gain for overall survival (P = 0.0049) and a borderline gain for IC response (P = 0.064).

For interpretation, the team used clustering-constrained attention multiple instance learning and gradient-weighted class activation mapping to visualize which image regions drove predictions.

Sources

  1. Peer-reviewedPLOS Digital Health2026-10-05

The debate