TRV-2026-2958Version 1 · Published

Saved · see the current record

Why this version exists

Certified into the record

The exact text we saved

This is the version exactly as it was saved, character for character. The SHA-256 hash below is a 64-character code worked out from that text. Run the same text through SHA-256 and you get the same code; change a single letter and the code comes out completely different. Each version also stores the previous version’s hash, which chains them together so no version can be swapped out quietly.

TRUVACE RECORD VERSION
record: TRV-2026-2958
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-11-16T06:02:13.036179Z
status: published
lens: p_space
sector: health
headline: Cognitive Evaluation of Multimodal Large Language Models in Dental Radiography
dek: Objectives: We evaluated the cognitive capabilities and safety boundaries of general-purpose, zero-shot multimodal large language models (MLLMs) in dental radiography.
Methods: OralMLLM-Bench comprised 27 independently evaluated tasks across periapical, panoramic, and lateral cephalometric radiographs, grouped into four categories: perception, comprehension, prediction, and decision-making. Six MLLMs and two clinician comparators were evaluated across 3,820 assessment units using sensitivity, specificity, balanc…
gain_title: (none)
problem_title: In a benchmark of six multimodal AI models on 3,820 dental radiograph assessment units, performance was weaker for low-contrast findings and spatial localization, and agreement with expert references was generally limited for prediction and decision-making tasks.
trace_subject: (none)
gain_reading: (none)
gain_evidence: (none)
problem_reading: In a benchmark of six multimodal AI models on 3,820 dental radiograph assessment units, performance was weaker for low-contrast findings and spatial localization, and agreement with expert references was generally limited for prediction and decision-making tasks.
problem_evidence: but lower performance for low-contrast findings and spatial localization | Agreement with expert image-based reference assessments was generally limited in prediction and decision-making tasks.
quick_read: Researchers tested six general-purpose multimodal AI models on dental X-rays using a new benchmark, OralMLLM-Bench, with 27 tasks across periapical, panoramic and lateral cephalometric images. Two clinician comparators were also assessed, across 3,820 assessment units in all.

The models did best on visually obvious findings, with sensitivity up to 0.917 for root filling detection and 0.875 for restoration detection. They did worse on low-contrast findings and on locating structures in space.

Only 6 of the 27 tasks showed significant differences between models after false discovery rate correction, and no model had a broad, consistent advantage. Errors included false positives caused by image artifacts, false negatives on low-contrast findings, and conclusions that did not match the model's own rationale, as well as uncertainty the models failed to flag.
limitation: The evaluation used standardized, image-only benchmark conditions, so results may not reflect how the models would perform with full clinical information.
tag: Evidence-backed problem
key_points: The benchmark, OralMLLM-Bench, has 27 independently evaluated tasks on periapical, panoramic and lateral cephalometric radiographs. | Tasks fall into four categories: perception, comprehension, prediction and decision-making. | Six multimodal AI models and two clinician comparators were assessed across 3,820 assessment units. | Sensitivity reached 0.917 for root filling detection and 0.875 for restoration detection. | Only 6 of 27 tasks showed significant between-model differences after false discovery rate correction. | Agreement with expert image-based reference assessments was generally limited in prediction and decision-making tasks. | Observed errors included artifact-induced false positives, low-contrast false negatives, spatial localization errors, conclusion-rationale inconsistency and unflagged diagnostic uncertainty.
rundown: The study evaluated general-purpose, zero-shot multimodal models, meaning none were specially trained for dental imaging. They were scored on sensitivity, specificity, balanced accuracy, a partial-credit average score and conditional rationale accuracy, which checks whether a model's explanation holds up.

Results varied by task. Models handled salient findings such as root fillings and restorations comparatively well, but struggled where contrast was low or where the answer required pinpointing location, and they fared worst on prediction and decision-making tasks.

The authors conclude that under standardized, image-only conditions the models showed task-dependent performance and persistent limitations, and offer the benchmark as a framework for judging the safety boundaries of such systems.
sources:
- peer_reviewed | Journal of Dentistry | https://doi.org/10.1016/j.jdent.2026.107174 | 2026-11-15
prev: 0000000000000000000000000000000000000000000000000000000000000000
SHA-256 hash
246c8dcc6dd1877c1f0b0eb5acdc094f22f824f9e4c77a45372a8842b51b778e
Previous version’s hash
0000000000000000000000000000000000000000000000000000000000000000
Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-2958 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.