Moderate evidence
Published recordHealthProblem Space
More
Benchmarking Large Language Models for Sentiment Analysis in Pregnancy-Related Weight Discussions on Reddit: Human Performance-Aligned Comparative Evaluation Study
- Truvace record
- TRV-2026-2935raw data (JSON)
- Version
- v1Published
- First published
- Evidence type
- Benchmark or lab evaluation
- Sources
- 1 sourcePeer-reviewed
- sha256
- c9cb8b6c9c98…check it
Background Pregnancy-related weight gain is both physiologically complex and socially charged, and online discussions often combine clinical information with implicit emotional distress. Although automated sentiment analysis could support research on pregnancy-related discourse, model performance in this context remains inadequately characterized relative to expert human judgment. Objective This study aimed to benchmark contemporary sentiment classification models on pregnancy-related weight discussions, with em…
The problem
In a JMIR Formative Research benchmark of 10 models on 150 Reddit pregnancy-weight posts, the best (Gemini-3-Flash) reached a weighted F1 of 0.662 against expert consensus, and the authors say such tools cannot stand alone as a measure of patient experience.
What this doesn’t fix
The models were tested on only 150 held-out posts, the two primary experts agreed on just 59.0% of posts before adjudication, and confidence intervals overlapped across the leading models, so rankings are uncertain.
Sources
1 on file- JMIR Formative Researchdoi:10.2196/92821
Cite this record
v1Truvace Impact Record TRV-2026-2935, v1: “Benchmarking Large Language Models for Sentiment Analysis in Pregnancy-Related Weight Discussions on Reddit: Human Performance-Aligned Comparative Evaluation Study.” Truvace, 2026-11-15. /record/TRV-2026-2935 (accessed on the day you copy it). sha256 c9cb8b6c9c98221b…
Change history
1 versionEvery change made to this record since it was first published, and why. Nothing has changed since it went up.
Certified into the record
Check this record hasn’t been altered
How to check it yourself, without trusting this page
Download any version from /api/record/TRV-2026-2935 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.
ace