INDEX

Explanations

the beginning of a new text or document.

oai_token-act-pair · gpt-4o Triggered by @ashater

car and vehicle related terms

oai_token-act-pair · gpt-3.5-turbo Triggered by @bot

New Auto-Interp

Configuration

jbloom/Gemma-2b-Residual-Stream-SAEs/gemma_2b_blocks.6.hook_resid_post_16384_anthropic_fast_lr

Prompts (Dashboard)

24,576 prompts, 128 tokens each

Dataset (Dashboard)

HuggingFaceFW/fineweb

Features

16,384

Data Type

torch.float32

Hook Point

blocks.6.hook_resid_post

Architecture

standard

Context Size

1,024

Dataset

HuggingFaceFW/fineweb

Hook Point Layer

Activation Function

relu

Embeds

PlotsExplanationShow Test FieldDefault Test Text

IFrame

Link

Not in Any Lists

No Comments

Negative Logits

 unlaw

-2.25

 disgra

-2.11

 unspeak

-2.11

 impractica

-1.99

 belliger

-1.94

 despotism

-1.93

 unwarran

-1.85

 reluct

-1.82

 ruinous

-1.81

 exasper

-1.75

POSITIVE LOGITS

<bos>

17.39

expandindo

2.80

GEBURTSDATUM

2.79

 betweenstory

2.79

تقاوى

2.69

 Administrativna

2.68

Autoritní

2.65

 Italijani

2.52

 Италијани

2.49

 Мексичка

2.44

Activations Density 0.176%

the beginning of a new text or document.

car and vehicle related terms

No Comments

No Known Activations