The Challenges of Designing Intelligent Tutoring Systems for Health Care in Low-Income Latina Populations
Conversational intelligent tutoring systems (CITS) have the potential to bring health education to low-income communities at scale. Although educational attainment is usually low, the health literacy spectrum within these communities can be wide. Therefore, special attention should be paid when designing and evaluating CITS within these communities. Visual, linguistic, subject matter, and cultural models must be considered. Moreover, evaluating CITS can be challenging. The instruments used to assess the impact o…

In brief
Researchers used a community-engaged process to design a conversational intelligent tutoring system on breast cancer for Latinas from low-income communities in Chicago. They built an autonomous version and a wizard-of-Oz version operated remotely by researchers, then compared the experiences of two women who used it.
The case study matters because health education tools aimed at low-income groups must reflect varied health literacy, culture and language, and assessment tools may misrepresent some users. The source describes only two cases, so it cannot show how often this happens or whether the system improves health outcomes.
Main points
- The tutoring system focuses on breast cancer education for Latinas in low-income Chicago communities.
- Two versions were built: an autonomous one and a wizard-of-Oz one controlled remotely by researchers.
- The design had to account for visual, linguistic, subject matter, and cultural models.
- Evaluation instruments need to reflect the health literacy levels of the people using the system.
The problem
In a two-woman case study of a breast cancer conversational tutor, the evaluation instruments did not seem to accurately capture one participant's experience, though both would normally be grouped together in statistical analysis.
The rundown
The authors argue that conversational tutoring systems could deliver health education at scale in low-income communities, but that these communities can show a wide spread of health literacy even when educational attainment is typically low.
The wizard-of-Oz version appears to work autonomously to users but is run by researchers to control for potential flaws in its artificial intelligence engine, allowing the design to be tested without relying only on the autonomous engine.
In the case study, two women who would traditionally be grouped together for statistical analysis gave evaluations suggesting the instruments captured one woman's experience poorly. The authors call for culturally grounded systems and evaluation instruments that faithfully capture all participants' experiences.
Sources
- Peer-reviewedHealth Education & Behavior2026-10-08
ace
The debate