Collingray's group workspace
gpt2_wikitext
What makes this group special?
Tags
gpt2_wikitext_16x_v2
Notes
Author
State
Finished
Start time
April 16th, 2024 5:16:57 AM
Runtime
6h 3m
Tracked hours
6h 2m 56s
Run path
collingray/multilayer_sae/bt6hfsxr
OS
Linux-6.7.8-arch1-1-x86_64-with-glibc2.39
Python version
3.11.4
Git repository
git clone https://github.com/collingray/autoencoders
Git state
git checkout -b "gpt2_wikitext_16x_v2" ef37789752872ebbd07aff953d00d5815dd7f40a
Command
multilayer_experiments.ipynb
System Hardware
| CPU count | 6 |
| Logical CPU count | 12 |
| GPU count | 1 |
| GPU type | NVIDIA GeForce RTX 4090 |
W&B CLI Version
0.16.4
Group
gpt2_wikitextConfig
Config parameters are your model's inputs. Learn more
- {} 15 keys▶
- [] 12 items▶
- 1
- "log"
- "cuda"
- "torch.bfloat16"
- 262,144
- 0.04
- 12,288
- 768
- "autoencoder"
- 16
- true
- "./weights"
- 42
- false
Summary
Summary metrics are your model's outputs. Learn more
- {} 89 keys▶
- 0.003954166546463966
- 141.46575927734375
- [] 65 items▶
- [] 64 items▶
- 0.0012690711300820112
- 94.98738098144533
- [] 65 items▶
- [] 64 items▶
- 0.765625
- 0.03466796875
- 0.00396728515625
- 0.004373414441943169
- 142.98341369628906
- [] 65 items▶
- [] 64 items▶
- 1.3046875
- 0.06591796875
- 0.013671875
- 0.0037291168700903654
- 149.3677520751953
- [] 65 items▶
- [] 64 items▶
- 2.140625
- 0.09716796875
- 0.01165771484375
- 0.004041503649204969
- 146.2940673828125
- [] 65 items▶
- [] 64 items▶
- 1.484375
- 0.07177734375
- 0.01263427734375
- 0.0033776815980672836
- 148.79832458496094
- [] 65 items▶
- [] 64 items▶
- 1.4375
- 0.068359375
- 0.01055908203125
- 0.0034362541045993567
- 147.4556121826172
- [] 65 items▶
- [] 64 items▶
- 1.0703125
- 0.053466796875
- 0.0107421875
- 0.6640625
- 0.02978515625
- 0.00311279296875
- 0.00000004898400871955
46 ... 84▶▶
Artifact Outputs
This run produced these artifacts as outputs. Total: 1. Learn more
Type
Name
Consumer count
Loading...