Truace
Subscribe

Evidence-grounded road safety countermeasure recommendation from crash-context queries: A modular LLM framework

Traffic safety countermeasure recommendation requires simultaneous consideration of crash context, roadway facility, traffic control, operating conditions, and evidence applicability. Traditional rule-based and keyword-matching methods have difficulty processing natural-language crash-context queries. This study proposes an evidence-grounded and mechanism-aware framework that formulates traffic safety countermeasure recommendation as the construction, selection, and ranking of CMF Evidence Cards. A structured CM…

By the Truvace desk2 min read1 sourcePeer-reviewedTRV-2026-1806· cite & verify
Evidence-grounded road safety countermeasure recommendation from crash-context queries: A modular LLM framework
"M67 motorway traffic jam - geograph.org.uk - 3415782" by Steve Fareham is licensed under CC BY-SA 2.0. To view a copy of this license, visit https://creativecommons.org/licenses/by-sa/2.0/.

In brief

Researchers built a framework that turns natural-language descriptions of crash situations into ranked traffic safety countermeasure recommendations. It draws on a store of 8844 evidence cards derived from the CMF Clearinghouse, narrows the candidates through retrieval, recall augmentation and applicability filtering, and then has a fine-tuned language model pick up to three.

The approach matters because rule-based and keyword methods struggle with free-text crash queries, and this one ties each recommendation to its source evidence and applicability conditions. Exact-match accuracy was moderate, though, and the authors report that retrieval remains weak in specialized settings such as work zones.

Main points

  1. The evidence store holds 8844 Evidence Cards, tested against 2935 crash-context queries that include 1000 deliberately incomplete variants.
  2. The fine-tuned Qwen3-32B reached 53.14% Exact Evidence Top-1 and 83.26% Mechanism Hit@3.
  3. It correctly decided when no evidence applied in 95.08% of empty-set cases.
  4. Evidence coverage in the candidate pool saturated at about 30 Evidence Cards.
  5. Independent expert evaluation supported the relevance and engineering applicability of the recommendations.

The gain

A fine-tuned Qwen3-32B framework retrieved and ranked CMF Evidence Cards for crash-context queries, placing the exact evidence in its top three in 76.15% of cases and beating a BM25-RAG baseline.

The rundown

The pipeline has three candidate-construction steps: context-aware retrieval, mechanism-aware recall augmentation and engineering applicability filtering. The language model, fine-tuned by supervised learning, then selects and ranks up to three Evidence IDs. Each is returned with a countermeasure description, CMF or CRF values, evidence quality, applicability conditions and literature sources.

Ablation tests confirmed that each of the three candidate-construction components contributes distinctly. The framework also stayed stable across semantically equivalent paraphrases of the same query and outperformed a conventional BM25-RAG baseline.

Evaluation combined LLM-assisted and independent expert review, which supported contextual relevance, mechanism consistency and overall usefulness. Case studies covered mechanism-complex and facility-specific scenarios.

Sources

  1. Peer-reviewedAccident Analysis & Prevention2026-10-17

The debate