residual stream · 7 layers · idle
A Penny for Your Thoughts
An interactive view of Anthropic's Natural Language Autoencoders

Ask a small question.
Then peek at what the model was thinking.

Gemma-3-12B-ITanswers your question. For a penny, you can watch its layer-32 activations translated back into language by Anthropic's released verbalizer — first as a narrative, then as the raw concepts at each token.

or try