aceLLM recommendations of local musculoskeletal providers for patient queries in Lynchburg VA and Trumbull CT
Source article: Artificial Intelligence Can Direct Patients Toward a Complaint-specific Musculoskeletal Provider
Abstract: Introduction Patients with musculoskeletal complaints often search online to identify an appropriate healthcare provider. With the increasing availability of large language models (LLMs), these artificial intelligence (AI) tools can direct patients to providers. This study evaluated the ability of LLMs to recommend appropriate providers based on representative patient musculoskeletal queries. Methods Three LLMs (ChatGPT, DeepSeek, and Gemini) were prompted with standardized musculoskeletal queries for two US cit…
Contested: both sides are scored from claims and sources, not community votes.
Physical Therapy - The Noun Project by undefined. CC0 · http://creativecommons.org/publicdomain/zero/1.0/deed.en
Researchers prompted ChatGPT, DeepSeek, and Gemini with standardized musculoskeletal complaints for Lynchburg, VA and Trumbull, CT, and judged whether recommended physicians were currently practicing locally in the relevant specialty and whether phone numbers were correct. By the August 13, 2026 publication date, ChatGPT was appropriate in all 17 recommendations, while Gemini and DeepSeek were appropriate in 43% and 40% of recommendations respectively.
The findings matter because patients increasingly use LLMs to choose providers, so accurate specialty and location matching could improve triage, but inaccurate contact details could delay care. It remains uncertain how performance generalizes beyond the two cities, standardized queries, and three models tested, and how to ensure provider contact information is accessible to models.
- Study prompted ChatGPT, DeepSeek, and Gemini with standardized musculoskeletal queries for Lynchburg, VA and Trumbull, CT.
- Appropriateness was defined as physician currently practicing in requested location and specialized in relevant area, with phone numbers checked for accuracy.
- ChatGPT was 17/17 appropriate, Gemini 9/21, DeepSeek 4/10, with statistical comparison via Fisher exact tests.
Large language models directed patients with musculoskeletal complaints to currently practicing, specialty-appropriate providers in the requested city, with ChatGPT achieving 100% appropriateness in the tested queries.
When recommending musculoskeletal providers, LLMs at times provided inaccurate phone numbers and contact information, potentially preventing patients from reaching the appropriate clinic.
The rundown
Three models were tested with identical prompts for two cities; appropriateness required current practice in the requested location and relevant specialization, and listed phone numbers were verified.
Results showed variation by model: ChatGPT 17/17 appropriate, Gemini 9/21, DeepSeek 4/10, with authors noting potential utility but also contact inaccuracies as tools evolve.
Findings are limited to standardized queries for two US cities and three specific LLMs, restricting generalizability to other locations, complaints, or models.
Sources
- Peer-reviewedJAAOS: Global Research and Reviews2026-08-13
How should this claim be treated?
The debate