Prospective multicentre expert evaluation of an artificial intelligence-based oncology clinical decision support system across major cancer types in India

Introduction: Cancer is a major public health challenge in India, with an estimated 1.4 million new cases each year. Despite this burden, the ratio of oncologists to new cancer patients is critically low, about one specialist per 1600 new diagnoses per year. The AI-driven CDSS could help offset the oncologist shortage in LMICs. OneRx.AI is an RAG platform grounded in international and national oncology guidelines. We evaluated its Expert-rated accuracy, clinical safety, Guideline concordance and decision impact,…

Prospective multicentre expert evaluation of an artificial intelligence-based oncology clinical decision support system across major cancer types in India
"McArdle Laboratory for Cancer Research" by wackybadger is licensed under CC BY-SA 2.0. To view a copy of this license, visit https://creativecommons.org/licenses/by-sa/2.0/.

In brief

Researchers tested OneRx.AI, a retrieval-augmented platform grounded in international and national oncology guidelines, at three tertiary oncology centres in India. Three oncologists independently reviewed de-identified clinical queries covering five cancer types, and 110 of 124 submitted queries were eligible.

India has very few oncologists relative to new cancer diagnoses, so tools that speed guideline-based decisions could ease specialist shortages. The authors describe the evaluation as exploratory, and results were affected by ceiling effects, so a larger follow-up study is needed before firm conclusions about real-world use.

Main points

  1. Of 124 submitted queries, 110 (88.7%) met the eligibility criteria.
  2. Expert-rated clinical safety was 100%, and citation accuracy was 86.4%.
  3. The decision-influence rate was 92.7%, and physician confidence rose by a mean of 1.69.
  4. Inter-rater reliability for clinical accuracy was Gwet's AC1 = 0.707.
  5. Median time to recommendation fell from 389.2 s to 47.2 s, an 87.9% reduction.

The gain

At three Indian tertiary cancer centres, oncologists using OneRx.AI reached clinical recommendations far faster, with high expert-rated accuracy, safety and guideline concordance.

The rundown

The study was a prospective, multicentre expert-validation design at three tertiary oncology centres. Three oncologist-clinicians rated queries on accuracy, safety, guideline concordance, decision impact, confidence and efficiency. Individual and common-prompt phases were analysed separately.

Co-primary endpoints used one-sample z-tests with 95% Wilson confidence intervals. Safety and guideline concordance ratings were uniform across evaluators, while clinical accuracy agreement was measured with a pre-specified statistic.

The motivating context is a shortfall of about one oncologist per 1600 new diagnoses per year, against roughly 1.4 million new cancer cases annually in India. The authors suggest AI decision support could help offset such shortages in low- and middle-income countries.

Sources

  1. Peer-reviewedInternational Journal of Medical Informatics2026-09-29

The debate