52/100

Moderate evidence

ProblemPublished recordHealthProblem Space

Benchmarking Large Language Models for Sentiment Analysis in Pregnancy-Related Weight Discussions on Reddit: Human Performance-Aligned Comparative Evaluation Study

Truvace record
TRV-2026-2935raw data (JSON)
Version
v1Published
First published
Evidence type
Benchmark or lab evaluation
Sources
1 sourcePeer-reviewed
sha256
c9cb8b6c9c98…check it

Background Pregnancy-related weight gain is both physiologically complex and socially charged, and online discussions often combine clinical information with implicit emotional distress. Although automated sentiment analysis could support research on pregnancy-related discourse, model performance in this context remains inadequately characterized relative to expert human judgment. Objective This study aimed to benchmark contemporary sentiment classification models on pregnancy-related weight discussions, with em…

The problem

In a JMIR Formative Research benchmark of 10 models on 150 Reddit pregnancy-weight posts, the best (Gemini-3-Flash) reached a weighted F1 of 0.662 against expert consensus, and the authors say such tools cannot stand alone as a measure of patient experience.

What this doesn’t fix

The models were tested on only 150 held-out posts, the two primary experts agreed on just 59.0% of posts before adjudication, and confidence intervals overlapped across the leading models, so rankings are uncertain.

Sources

1 on file
  1. Peer-reviewed2026-11-13

Cite this record

v1

Truvace Impact Record TRV-2026-2935, v1: “Benchmarking Large Language Models for Sentiment Analysis in Pregnancy-Related Weight Discussions on Reddit: Human Performance-Aligned Comparative Evaluation Study.” Truvace, 2026-11-15. /record/TRV-2026-2935 (accessed on the day you copy it). sha256 c9cb8b6c9c98221b…

Change history

1 version

Every change made to this record since it was first published, and why. Nothing has changed since it went up.

  1. Publishedv1c9cb8b6c9c98…

    Certified into the record

Check this record hasn’t been altered

Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-2935 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.