INDEX

Explanations

words related to height or spatial orientation

oai_token-act-pair · gpt-3.5-turbo

words and phrases that end with specific sounds, particularly the 'igh', 'ip', 'unch', and 'ay' endings

oai_token-act-pair · gpt-4o-mini Triggered by @bot

New Auto-Interp

Top Features by Cosine Similarity

Comparing With GPT2-SMALL @ 5-res-jb

Configuration

jbloom/GPT2-Small-SAEs-Reformatted/blocks.5.hook_resid_pre

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

Skylion007/openwebtext

Features

24,576

Data Type

torch.float32

Hook Point

blocks.5.hook_resid_pre

Architecture

standard

Context Size

128

Dataset

Skylion007/openwebtext

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

ONSORED

-0.71

IDER

-0.71

Interstitial

-0.70

redits

-0.69

Hopefully

-0.67

 certific

-0.66

Credits

-0.66

Journal

-0.66

ngth

-0.64

ORGE

-0.64

POSITIVE LOGITS

etheless

1.01

iqueness

0.90

withstanding

0.80

hawk

0.74

theless

0.73

mares

0.72

anmar

0.71

ensical

0.71

oleon

0.70

ully

0.69

Activations Density 0.057%

words related to height or spatial orientation

words and phrases that end with specific sounds, particularly the 'igh', 'ip', 'unch', and 'ay' endings

No Comments

No Known Activations