Sparse autoencoders (SAEs) could turn AI models in Biology and other fields into engines of scientific discovery by explaining the superhuman capabilities of those models. We postulate that a latent is useful if we know three things: whether it is coherent, whether it can be described, and whether that description has predictive power. These questions are routinely conflated. We assemble them into a single pipeline and report some practical innovations. First, cross-seed dictionary stability prioritises which latents are worth spending resources to investigate. Second, an intruder-detection task asks whether a latent's activating examples share a recognizable pattern. Third, a separate pass proposes a candidate biological description which we convert into falsifiable predictions which can be tested in silico. Deployed on the Boltz-1 Pairformer trunk, stability prioritisation finds interpretable latents using about 4.4 times fewer latent evaluations each, and at 5.2 times lower measured LLM cost, while recovering over half of them. However, we notice that in our setup the LLM judge is heavily biased towards consistent residue identity and a simple filter that selects for features with high amino-acid identity precision outperforms the stability thresholding. This simpler method has the added benefit of requiring no extra SAE seeds but it remains uncertain if it reflects a genuinely useful heuristic or an limitation of the LLM judge.
翻译:暂无翻译