AI Tutors, Worksheets, and Task Design: Matching AI Tools to Learning Structure

Artificial intelligence is increasingly used by students as a learning resource in STEM courses. However, classroom observations and survey data suggest that unstructured AI use may correlate with reduced student achievement. Two concerns are especially relevant: AI systems can produce incorrect responses in tasks requiring precise validation, and students may use AI in ways that reduce active engagement with course material. This session presents two instructional approaches designed to address these limitation…

AI Tutors, Worksheets, and Task Design: Matching AI Tools to Learning Structure
Introductory lecture by the Hon. John Rolph [microform] : delivered before the faculty and students of medicine of the University of Victoria College, Toronto, session, 1860-61 by Rolph, John, 1793-1870. Public domain

In brief

A conference session abstract describes two instructional approaches built to counter weaknesses in how students use AI in STEM courses: AI-generated worksheets that stay within instructor-set constraints, and in-chat tutors that use problem generation, Socratic questioning and feedback. The approaches were developed and tested iteratively, mainly in introductory chemistry.

The work matters because students already use AI as a learning resource, and the abstract reports that unstructured use may be associated with lower achievement. Its central claim is that the right tool depends on the structure of the learning task. The abstract gives no quantitative outcomes, so how well each approach works remains unclear.

Main points

  1. Observations and survey data link unstructured AI use in STEM courses to possibly reduced student achievement; the abstract describes this as a correlation.
  2. Two named concerns are incorrect AI answers on tasks needing precise validation and reduced active engagement with course material.
  3. AI worksheets generate controlled practice problem sets within instructor-defined course constraints.
  4. In-chat tutors offer interactive practice through problem generation, Socratic questioning and feedback-driven guidance.
  5. Four task types are examined: conceptual, low-ambiguity structured, multi-step quantitative, and highly deterministic symbolic or structural.

The problem

Classroom observations and survey data suggest that unstructured AI use in STEM courses may correlate with reduced student achievement, partly through incorrect AI answers and lower active engagement.

The rundown

The abstract frames the issue as a mismatch between AI tools and learning structure. Students increasingly use AI in STEM courses, but classroom observations and survey data suggest unstructured use may correlate with reduced achievement, and the text does not claim a causal effect.

The authors drew on iterative development and testing primarily in introductory chemistry. Examples include chemical nomenclature, dimensional analysis, stoichiometry, Lewis structures, laboratory writing and mathematical validation, which show where different AI approaches worked reliably and where they did not.

Attendees are promised ready-to-use prompts for both worksheet systems and in-chat tutors, implementation strategies and observed limitations. The session ends with a framework for choosing AI tools by the structure of the learning task rather than by disciplinary content alone.

The debate