TRV-2026-3025Version 1 · Published

Saved · see the current record

Why this version exists

Certified into the record

The exact text we saved

This is the version exactly as it was saved, character for character. The SHA-256 hash below is a 64-character code worked out from that text. Run the same text through SHA-256 and you get the same code; change a single letter and the code comes out completely different. Each version also stores the previous version’s hash, which chains them together so no version can be swapped out quietly.

TRUVACE RECORD VERSION
record: TRV-2026-3025
version: 1
kind: certified
reason: Certified into the record
timestamp: 2026-11-18T12:02:23.148730Z
status: published
lens: trace
sector: science
headline: LLMs in the Laboratory: Benchmarking Conversational AI for Multivariate Analysis of NMR Spectroscopic Data
dek: This study presents a comparative evaluation of five state-of-the-art large language models (LLMs) (Claude Opus 4.6, Gemini 3.1 Pro, Grok-4, ChatGPT (GPT-5.4 Thinking), and Qwen 3.5) for their ability to perform key chemometric tasks through natural language interaction. Using a low-field nuclear magnetic resonance (LF-NMR) dataset of edible vegetable oils, the models were prompted to execute a complete multivariate analysis workflow, including data exploration, unsupervised and supervised classification, model…
gain_title: In a benchmark of five chatbots on low-field NMR data from edible vegetable oils, Claude Opus 4.6 ran the whole analysis pipeline on its own and correctly predicted all nine unlabeled samples.
problem_title: In a benchmark of five chatbots on low-field NMR data from edible vegetable oils, the open-source Qwen 3.5 failed unrecoverably at the supervised classification stage and could not finish the workflow, and Grok-4 showed limits in data handling autonomy.
trace_subject: Chatbot performance on NMR multivariate analysis of vegetable oils
gain_reading: In a benchmark of five chatbots on low-field NMR data from edible vegetable oils, Claude Opus 4.6 ran the whole analysis pipeline on its own and correctly predicted all nine unlabeled samples.
gain_evidence: Claude Opus 4.6 was the only model to autonomously execute the entire pipeline with the highest analytical rigor, correctly predicting all nine unlabeled samples.
problem_reading: In a benchmark of five chatbots on low-field NMR data from edible vegetable oils, the open-source Qwen 3.5 failed unrecoverably at the supervised classification stage and could not finish the workflow, and Grok-4 showed limits in data handling autonomy.
problem_evidence: Qwen 3.5, the only open-source model, suffered a critical, unrecoverable failure at the supervised classification stage after repeated attempts, preventing workflow completion. | Grok-4 produced near-perfect classification results but showed limitations in data handling autonomy and exploratory depth.
quick_read: A study in Analytical Chemistry compared five large language models on a complete multivariate analysis of low-field NMR data from edible vegetable oils. The models were Claude Opus 4.6, Gemini 3.1 Pro, ChatGPT (GPT-5.4 Thinking), Grok-4 and Qwen 3.5, and each was prompted in natural language to explore data, classify samples, validate models and interpret results.

Claude Opus 4.6 was the only model to run the whole pipeline autonomously, and it correctly predicted all nine unlabeled samples. Gemini 3.1 Pro and ChatGPT reached 100% or near-100% classification accuracy, though within fallback or native workflows. Qwen 3.5 failed at the supervised classification stage and could not complete the work.

The authors conclude that fluent language is not a reliable sign of analytical competence, and that general-purpose benchmarks may miss weaknesses in domain-specific chemometric work. They say critical validation and human oversight remain essential when these tools are used in spectroscopy workflows.
limitation: The evaluation used a single low-field NMR dataset of edible vegetable oils, and the authors note that general-purpose benchmarks may have limitations for domain-specific chemometric performance.
tag: Dual reading
key_points: Five models were tested: Claude Opus 4.6, Gemini 3.1 Pro, Grok-4, ChatGPT (GPT-5.4 Thinking) and Qwen 3.5. | The task was a full multivariate workflow on a low-field NMR dataset of edible vegetable oils, from data exploration to interpretation. | Claude Opus 4.6 alone completed the whole pipeline autonomously and predicted all nine unlabeled samples correctly. | Gemini 3.1 Pro and ChatGPT reached 100% or near-100% classification accuracy within fallback or native workflows. | Grok-4 classified almost perfectly but was weaker on data handling autonomy and exploratory depth. | Qwen 3.5, the only open-source model, failed unrecoverably at supervised classification after repeated attempts.
rundown: The study evaluated the models through natural language interaction rather than hand-written code, asking each to carry out the steps of a chemometric workflow: data exploration, unsupervised and supervised classification, model validation and interpretation. The data came from low-field NMR measurements of edible vegetable oils.

Results formed a clear hierarchy. Claude Opus 4.6 ran everything on its own with the highest analytical rigor. Gemini 3.1 Pro and ChatGPT (GPT-5.4 Thinking) were described as effective analytical co-pilots, with accuracy at or near 100% in fallback or native workflows. Grok-4 produced near-perfect classification but needed more handling help and explored the data less deeply.

Qwen 3.5 could not get past supervised classification despite repeated attempts. The authors say the spread in results shows that linguistic fluency is a poor guide to analytical competence and that general benchmarks may not capture domain-specific chemometric performance, so human oversight is still needed.
sources:
- peer_reviewed | Analytical Chemistry | https://doi.org/10.1021/acs.analchem.6c02701 | 2026-11-17
prev: 0000000000000000000000000000000000000000000000000000000000000000
SHA-256 hash
a0d5b891c5c2aa9c21905bada9f68961444f6871ba4aaac26d947d39a4f3d919
Previous version’s hash
0000000000000000000000000000000000000000000000000000000000000000
Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-3025 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.