pythia-70m-deduped · 1-res-sm
    SAE from p70d-sm · Residuals · Layer 1
    Jump to Source/SAE
    Jump to Feature
    INDEX
    Features
    32,768
    Data Type
    torch.float32
    Hook Name
    blocks.1.hook_resid_post
    Hook Layer
    1
    Architecture
    standard
    Context Size
    128
    Dataset
    EleutherAI/the_pile_deduplicated
    Activation Function
    relu

    SAE Evaluations

    SAE Bench
    No Evals Found