Neuronpedia
Get Started
API
Releases
Jump To
Search
Models
Steer
SAE Evals
Blog
Slack
Privacy & Terms
Contact
Sign In
© Neuronpedia 2025
Privacy & Terms
Blog/RSS
GitHub
Slack
Twitter
Contact
EXPLANATION TYPE
oai_attention-head
Description
OpenAI's Attention Head explainer, written for transformer-debugger.
Author
OpenAI
URL
https://github.com/openai/transformer-debugger/blob/main/neuron_explainer/explanations/explainer.py
Settings
Default prompts from the main branch, using AttentionHeadExplainer.
Recent Explanations
attends to the word "capital" from the start of the sequence.
gpt-4o
<bos>
what
is
the
capital
of
india
?
GEMMA-2B
6-RES-JB
INDEX 6709
attends to the token "iPhone" from the token "Android".
gpt-4o
<bos>
I
love
my
iPhone
more
than
my
Android
GEMMA-2B
6-RES-JB
INDEX 5276
attends to the start of the sentence from various sentence tokens.
gpt-4o
<bos>
The
CEO
of
Tesla
is
Elon
GEMMA-2B
6-RES-JB
INDEX 8246
attends to the beginning-of-sequence token from itself.
gpt-4o
<bos>
Hey
there
!
Just
wanted
to
GEMMA-2B
6-RES-JB
INDEX 240
attends to the beginning of a sequence from any token.
gpt-4o
<bos>
colour
GEMMA-2B
6-RES-JB
INDEX 2330
attends to the list separator "pipe" symbol from subsequent tokens, typically found in sequences of items or lists.
gpt-4o
Frontier
||
Toyota
Tacoma
|
<bos>
2
0
0
8
Saab
GEMMA-2B
6-RES-JB
INDEX 4416
attends from the beginning of the sequence to the beginning of the sequence.
gpt-4o
<bos>
appy
GEMMA-2B
6-RES-JB
INDEX 14131
attends from the beginning-of-sequence token to entity beginnings such as the start of names or titles.
gpt-4o
<bos>
statue
of
liberty
GEMMA-2B
6-RES-JB
INDEX 3291
attends from the start of a sequence to the first item in a list or series.
gpt-4o
<bos>
The
Golden
Gate
Bridge
.
The
Bay
Bridge
.
London
GEMMA-2B
6-RES-JB
INDEX 9245
attends from the beginning-of-sequence token to itself.
gpt-4o
underscores
the
urgency
of
integrating
environmental
considerations
into
city
planning
.
GEMMA-2B
6-RES-JB
INDEX 14875
attends from the beginning-of-sequence marker to the first token in the sentence.
gpt-4o
<bos>
'
To
Kill
a
Mocking
bird
GEMMA-2B
6-RES-JB
INDEX 3586
attends to the beginning of sequence token from itself.
gpt-4o
<bos>
li
les
GEMMA-2B
6-RES-JB
INDEX 3754
attends from the beginning-of-sequence token to the beginning-of-sequence token.
gpt-4o
<bos>
Post
in
'
The
Ing
len
ook
'
started
by
GEMMA-2B
6-RES-JB
INDEX 10004
attends from occurrences of "pick" to other nearby occurrences of "pick" (such as forms like "pick up").
gpt-4o
approach
to
song
learning
.
Pick
your
favorite
track
from
our
GEMMA-2B
6-RES-JB
INDEX 1001
attends to the implementation or status of installations from descriptions or details of software and systems.
gpt-4o
.
Installation
instructions
and
a
Getting
Started
GEMMA-2B
6-RES-JB
INDEX 1000
attends to the presence of sovereign credit ratings in the text.
gpt-3.5-turbo
Ratings
agency
Standard
&
Poor
'
s
affirmed
India
'
GEMMA-2B
6-RES-JB
INDEX 471
attends to financial or ratings-related organizations from their corresponding ratings or outlooks.
gpt-4o
Ratings
agency
Standard
&
Poor
'
s
affirmed
India
'
GEMMA-2B
6-RES-JB
INDEX 471
attends to the token "face" from pairs of tokens that describe a physical face or surface.
gpt-3.5-turbo
on
at
least
one
face
of
a
continuously
cast
aluminum
core
GEMMA-2-2B
0-GEMMASCOPE-ATT-16K
INDEX 333
attends to location tokens related to "Carolina" from subsequent numerical or ranking tokens.
gpt-4o-mini
24
8
.
74
East
Carolina
6
-
1
23
21
GPT2-SMALL
0-ATT-KK
INDEX 14024
attends to tokens indicating relationships or interactions from tokens related to conflict or comparison.
gpt-4o-mini
was
a
meeting
on
Wednesday
between
chief
minister
Dev
endra
F
GPT2-SMALL
0-ATT-KK
INDEX 14023
