A transdisciplinary AI-based framework for usability evaluation in digital health systems

Introduction. As healthcare systems undergo rapid digital transformation, the usability of clinical and patient-facing technologies has become critical to adoption, user satisfaction, and patient safety. Traditional usability evaluation methods are limited in capturing the real-time cognitive, emotional, and behavioural complexities of interaction in high-stakes environments. Method. This study presents a transdisciplinary evaluation of an AI-augmented usability framework for healthcare interfaces. The framework…

A transdisciplinary AI-based framework for usability evaluation in digital health systems
Public Health Service Crisis Response Service Award ribbon by This image includes elements that have been taken or adapted from this file:. Public domain

In brief

Researchers built and tested a usability evaluation framework for healthcare interfaces that draws on AI, cognitive science, usability engineering and clinical practice. Forty healthcare professionals and patients completed standardized tasks under either traditional or AI-enhanced evaluation.

The work matters because poorly usable clinical and patient-facing tools can affect adoption, satisfaction and safety, and the framework aims to surface cognitive and emotional friction as it happens. The abstract reports only one small study, so how well the results hold across other systems and settings is still unclear.

Main points

  1. The framework combines eye-tracking analytics, machine learning confusion prediction and NLP sentiment analysis.
  2. Forty participants, both healthcare professionals and patients, completed standardized tasks.
  3. Outcomes were compared using SUS scores, task completion time, error rate and task success rate.
  4. The confusion prediction model reached 89% accuracy and an F1-score of 0.88.
  5. Sentiment scores correlated strongly with self-reported satisfaction.

The gain

An evaluation framework combining eye-tracking, confusion prediction and sentiment analysis beat traditional usability testing on all core metrics for healthcare interfaces among 40 clinicians and patients.

The rundown

The study starts from the view that traditional usability methods struggle to capture real-time cognitive, emotional and behavioural complexity in high-stakes healthcare settings, even as health systems digitize quickly.

Participants were split between traditional and AI-enhanced evaluation. Beyond standard usability metrics, the AI tools supplied extra insight: eye-tracking identified areas of cognitive friction, and sentiment analysis tracked user satisfaction.

The authors say statistical analysis confirmed significant group differences and describe the framework as adaptive, emotionally aware and replicable, supporting user-centred design of safer digital health technologies.

The debate