70/100

Moderate evidence

Companion robots and chat agents eased loneliness in a review of 14 small studies

Study title: Efficacy of relational agents for loneliness across age groups: a systematic review and meta-analysis

Evidence type
Systematic review or meta-analysis
Sample
n = 286
Sources
1 sourcePeer-reviewed
Published
3 min read

Study title: Efficacy of relational agents for loneliness across age groups: a systematic review and meta-analysis

A systematic review and meta-analysis in BMC Public Health pooled 14 studies of relational agents, software or robots that build rapport through conversation and play and increasingly use AI. Together the studies covered 286 participants aged 19 to 100, and the pooled effect on self-reported loneliness was moderate (g = -0.552, Knapp-Hartung 95% CI -0.877 to -0.226).

Read the study abstract

Abstract Background Loneliness is a serious public health concern. Although previous interventions have had some success in mitigating loneliness, the field is in search of novel, more effective, and more scalable solutions. Here, we focus on “relational agents”, a form of software agents that are increasingly powered by artificial intelligence and large language models (LLMs). We report on a systematic review and meta-analysis to investigate the impact of relational agents on loneliness across age groups. Metho…

Efficacy of relational agents for loneliness across age groups: a systematic review and meta-analysis
"Health Counselling Session at University of Nigeria Nsukka" by Onwuka Glory, CC BY-SA 4.0.

The gain

A meta-analysis of 14 studies with 286 participants aged 19 to 100 found that relational agents (companion robots and app-based conversational agents) reduced self-reported loneliness by a moderate amount (Hedge's g = -0.552).

In brief

Social robots such as PARO, AIBO, NAO and Pepper showed a larger pooled effect (g = -0.774) than app-based agents such as Alexa and Elena+ (g = -0.286). The authors suggest the agents could complement existing loneliness services such as the NHS's social prescribing, and that a regional pilot could be a next step.

The evidence is fragile. Nearly all studies were small and at high risk of bias, and a publication-bias adjustment cut the estimate to g = -0.198, a drop of roughly 64%, with a confidence interval that included zero. The authors judge the true average effect to be small to moderate.

Main points

  1. The search of 11 databases up to 16 September 2022 found 3,935 records; 14 studies met the criteria, nine uncontrolled non-randomised trials and five randomised trials.
  2. Study sizes ranged from 4 to 42 participants, 286 in total; participants' ages ran from 19 to 100, and only two studies included anyone under 50.
  3. Nine studies used social robots (Sony's AIBO, PARO, NAO, Pepper, Joy for All pets) and five used app-based agents (Laura, Elena+, Alexa, Bella, PACO).
  4. Pooled effect: g = -0.552; the five randomised trials alone gave g = -0.437, significant at the conventional 0.05 level but not after Knapp-Hartung adjustment.
  5. Social robots gave g = -0.774 (Z = -2.909, P = 0.004) versus g = -0.286 for app-based agents, which was not significant after adjustment.
  6. Heterogeneity was substantial (I2 = 71%), and the 95% prediction interval ran from -1.519 to 0.415.
  7. Eighty-six percent of studies were classed as feasibility studies, and attrition ranged from 0 to 94%.
  8. The mean gap between pre-test and final post-test was 5.92 weeks.

The full story

The authors preregistered the review with PROSPERO and screened titles, abstracts and full texts independently in duplicate. Studies needed a quantitative self-reported loneliness outcome with follow-up of at least one week, and all agents were autonomous rather than human-operated. Risk of bias was rated with RoB 2 for randomised trials and ROBINS-I for non-randomised studies.

After removing 1,910 duplicates, reviewers screened 2,063 records and read 155 full texts. All randomised trials except one, and all non-randomised studies, were rated high risk of bias. Egger's test (P = 0.004) and funnel plots suggested a small-study effect. The trim-and-fill adjustment gave g = -0.198 (95% CI -0.505 to 0.109), though the authors argue it overcorrects under heterogeneity.

Subgroup results were mixed. Eight robot studies and six app studies were too few to give strong power, and the Bonferroni correction (α = 0.0125) was conservative. The authors point to the NHS's resource constraints and suggest agents as one option within social prescribing alongside human-centred schemes, and note that digital literacy, access and data privacy would need resolving in any pilot.

The authors call for more high-quality randomised trials with larger samples and longer follow-up. Young people were largely absent from the studies, and the agents' use of behaviour-change theory was rarely documented.

Sources

1 on file
  1. BMC Public Healthdoi:10.1186/s12889-024-19153-x
    Peer-reviewed2024-07-06

Talk it over

Four questions to start on
Who gets this benefit, and who was left out of the study or story?

Start with a question

Companion robots and chat agents eased loneliness in a review of 14 small studieshttps://truvace.com/item/efficacy-of-relational-agents-for-loneliness-across-age-groups-a-systematic-revi

  1. Who gets this benefit, and who was left out of the study or story?

    The gain A meta-analysis of 14 studies with 286 participants aged 19 to 100 found that relational agents (companion robots and app-based conversational agents) reduced self-reported loneliness by a moderate amount (Hedge's g = -0.552).

    Answer in the thread
  2. How do we know? What can this kind of evidence show, and what can’t it?

    The evidence This rests on a systematic review or meta-analysis with a sample of 286, from BMC Public Health.

    Answer in the thread
  3. What does it leave open? What else would you want to know before acting on it?

    The record’s own caveat Most of the 14 studies were small, high risk of bias and short in follow-up (mean 5.92 weeks), and a publication-bias adjustment shrank the effect by roughly 64% to a non-significant g = -0.198.

    Answer in the thread
  4. Have you seen AI used this way where you study, work or live? Did it go the same way?

    Answer in the thread

The questions are the same on every record. The details under them are taken from this record as written.

What readers say