"Army scientists energize battery research" by U.S. Army CCDC, CC BY-SA 2.0.A study finds a method that makes protein AI models easier to read than their own neurons
Researchers trained sparse autoencoders and a variant called transcoders on internal representations from layers 6 to 10 of ESM2, a protein language model, to pull out features a person can read.
Proceedings of the National Academy of Sciences
ace