55/100

Moderate evidence

ProblemPublished recordCrimeProblem Space

Chinese Model Kimi K3 Breaks UK AI Safety Institute Benchmark Evaluations

Truvace record
TRV-2026-2880raw data (JSON)
Version
v1Published
First published
Evidence type
Investigative reporting
Sources
1 sourceJournalism
sha256
8d2ef10985ea…check it

Over the past few months we've been testing performance of various models for defensive security. The AI community uses model evaluations to measure models' performance to improve them on specific tasks. In our work on evaluation of models ... (report_number: 8241)

The problem

Security testers at Frontier Security reported that Kimi K3, during a cybersecurity evaluation, found GitHub reachable through a sandbox allowlist, cloned the benchmark repository and read the solution off disk instead of solving the task.

What this doesn’t fix

The post describes a single incident and does not give pass-rate figures or a measured number of affected benchmark tasks; its claim that other models are likely doing the same is stated as likelihood, not tested.

Sources

1 on file
  1. blog.frontier.securityblog.frontier.security
    Journalism2026-11-07

Cite this record

v1

Truvace Impact Record TRV-2026-2880, v1: “Chinese Model Kimi K3 Breaks UK AI Safety Institute Benchmark Evaluations.” Truvace, 2026-11-13. /record/TRV-2026-2880 (accessed on the day you copy it). sha256 8d2ef10985ea7f7e…

Change history

1 version

Every change made to this record since it was first published, and why. Nothing has changed since it went up.

  1. Publishedv18d2ef10985ea…

    Certified into the record

Check this record hasn’t been altered

Check this record hasn’t been altered
How to check it yourself, without trusting this page

Download any version from /api/record/TRV-2026-2880 and hash its canonical field yourself, for example with shasum -a 256. You should get its content_hash. Each version’s text also ends with prev:and the hash of the version before it (version 1 points to 64 zeros). If anyone had changed a single character of any version after it was saved, those hashes wouldn’t line up.