aceDevelopment and Validation of a ChatGPT-Based Assessment for Conversation-Related Clinical Skills in Occupational Therapy OSCEs
ImportanceConversation-related clinical skills are central to Objective Structured Clinical Examinations (OSCEs) in occupational therapy. However, real-time examiner scoring is resource-intensive and may overlook students' specific skills. Transcript-based scoring with Chat Generative Pre-Trained Transformer (ChatGPT) may address these limitations.ObjectiveTo develop a ChatGPT-based assessment for chief-complaint interview OSCEs (G-ACE) and examine criterion validity against expert-consensus ratings, test-retest…
A ChatGPT-based tool scored student interview transcripts with acceptable repeat-scoring reliability and small absolute differences from expert ratings on domain and total scores, offering an alternative to resource-intensive real-time examiner scoring.
Some items showed lower consistency with expert ratings, and the rehabilitation expectations domain had weak inter-rater reliability, so formative feedback should be interpreted cautiously.
Evidence
- Peer-reviewedAmerican Journal of Occupational Therapy2026-11-03
How should this claim be treated?
Truvace Impact Record TRV-2026-2353, v1: “Development and Validation of a ChatGPT-Based Assessment for Conversation-Related Clinical Skills in Occupational Therapy OSCEs.” Truvace, 2026-11-03. /record/TRV-2026-2353 (accessed at citation time). sha256 85c88c962fde803a…
Calibration history
Every change to this record since certification, in the open. None yet — the reading has held since it entered the record.
Certified into the record
How to verify without trusting this page
Fetch the canonical text of any version from /api/record/TRV-2026-2353 and hash it yourself — for example shasum -a 256 on the saved canonical field. The result must equal content_hash, and each version’s text ends with prev:followed by the prior version’s hash (version 1 chains to 64 zeros). If a single character of any version had been altered since certification, the chain would not reproduce.