Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Buckets new
  • Docs
  • Enterprise
  • Pricing
    • Website
      • Tasks
      • HuggingChat
      • Collections
      • Languages
      • Organizations
    • Community
      • Blog
      • Posts
      • Daily Papers
      • Hardware
      • Learn
      • Discord
      • Forum
      • GitHub
    • Solutions
      • Team & Enterprise
      • Hugging Face PRO
      • Enterprise Support
      • Inference Providers
      • Inference Endpoints
      • Storage Buckets

  • Log In
  • Sign Up

seonglae
/
Llama-3.2-3B-sae

SAELens
Model card Files Files and versions
xet
Community

Instructions to use seonglae/Llama-3.2-3B-sae with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

  • Libraries
  • SAELens

    How to use seonglae/Llama-3.2-3B-sae with SAELens:

    # pip install sae-lens
    from sae_lens import SAE
    
    sae, cfg_dict, sparsity = SAE.from_pretrained(
        release = "RELEASE_ID", # e.g., "gpt2-small-res-jb". See other options in https://github.com/jbloomAus/SAELens/blob/main/sae_lens/pretrained_saes.yaml
        sae_id = "SAE_ID", # e.g., "blocks.8.hook_resid_pre". Won't always be a hook point
    )
  • Notebooks
  • Google Colab
  • Kaggle
Llama-3.2-3B-sae
906 MB
Ctrl+K
Ctrl+K
  • 1 contributor
History: 7 commits
seonglae's picture
seonglae
Update README.md
030551c verified over 1 year ago
  • Llama-3.2-3B_blocks.21.hook_resid_pre_18432_topk_64_0.0001_42_faithful-llama3.2-3b_512
    Upload SAE Llama-3.2-3B_blocks.21.hook_resid_pre_18432_topk_64_0.0001_42_faithful-llama3.2-3b_512 over 1 year ago
  • Llama-3.2-3B_blocks.21.hook_resid_pre_18432_topk_64_0.0001_42_fineweb_512
    Upload SAE Llama-3.2-3B_blocks.21.hook_resid_pre_18432_topk_64_0.0001_42_fineweb_512 over 1 year ago
  • Llama-3.2-3B_blocks.21.hook_resid_pre_18432_topk_64_0.0001_49_faithful-llama3.2-3b_512
    Upload SAE Llama-3.2-3B_blocks.21.hook_resid_pre_18432_topk_64_0.0001_49_faithful-llama3.2-3b_512 over 1 year ago
  • Llama-3.2-3B_blocks.21.hook_resid_pre_18432_topk_64_0.0001_49_fineweb_512
    Upload SAE Llama-3.2-3B_blocks.21.hook_resid_pre_18432_topk_64_0.0001_49_fineweb_512 over 1 year ago
  • .gitattributes
    1.52 kB
    initial commit over 1 year ago
  • README.md
    1.05 kB
    Update README.md over 1 year ago