INDEX

Explanations

references to influential or notable individuals, particularly in political contexts

oai_token-act-pair · gpt-4o-mini Triggered by @bot

attends to the name "John" from the Twitter handle or last name of the person named John.

oai_attention-head · claude-3-5-sonnet-20240620 Triggered by @danielepoterti

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 9-att-kk

Configuration

ckkissane/attn-saes-gpt2-small-all-layers/gpt2-small_L9_Hcat_z_lr1.20e-03_l11.20e+00_ds24576_bs4096_dc1.00e-06_rsanthropic_rie25000_nr4_v9.pt

Prompts (Dashboard)

36,864 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

float32

Hook Name

blocks.9.attn.hook_z

Hook Layer

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Activation Function

relu

Embeds

IFrame

Link

Not in Any Lists

No Comments

Head Attr Weights

0:0.05

1:0.02

2:0.05

3:0.04

4:0.06

5:0.03

6:0.13

7:0.05

8:0.06

9:0.42

10:0.02

11:0.03

Negative Logits

Sty

-3.50

 Planes

-3.48

ATF

-3.42

 Spike

-3.31

Tes

-3.23

●

-3.17

aza

-3.04

Tes

-3.03

 Shap

-3.00

Tol

-3.00

POSITIVE LOGITS

John

7.06

john

6.95

 John

6.91

JOHN

6.32

 JOHN

6.14

 Johnston

5.89

 john

5.88

 Johns

5.70

 Johnson

4.19

Johnson

4.19

Activations Density 0.037%

references to influential or notable individuals, particularly in political contexts

attends to the name "John" from the Twitter handle or last name of the person named John.

No Comments

No Known Activations