Skip to main content
jbloom
Projects
mats_sae_training_gpt2_small_resid_pre_5
Log in
Sign up
Overview
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts
Jbloom's workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Runs
21
Name
13 visualized
L0-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L0-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L1-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L1-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L2-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L2-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L3-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L3-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L4-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L4-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L5-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L5-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L6-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L6-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L7-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L7-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L8-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L8-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L9-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L9-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L10-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L10-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L11-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L11-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L12-24576-L1-4e-05-LR-0.0004-Tokens-3.000e+08
L12-24576-L1-4e-05-LR-0.0004-Tokens-3.000e+08
1-13
of 13
Settings
Add panels
Panel Section
9
1-8 of 9
metrics/CE_loss_score and hook_point_layer v. metrics/explained_variance
metrics/CE_loss_score and hook_point_layer v. metrics/explained_variance
0
2
4
6
8
10
hook_point_layer
0.90
0.92
0.94
0.96
0.98
1.00
metrics/explained_variance
0.9
0.92
0.94
0.96
0.98
1
metrics/CE_loss_score
metrics/CE_loss_score v. metrics/l0
metrics/CE_loss_score v. metrics/l0
20
40
60
80
100
metrics/l0
0.8
0.85
0.9
0.95
metrics/CE_loss_score
metrics/explained_variance
metrics/explained_variance
0.9
0.95
1
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
losses/mse_loss
losses/mse_loss
0
0.005
0.01
0.015
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
losses/l1_loss
losses/l1_loss
0
100
200
300
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
metrics/CE_loss_score
metrics/CE_loss_score
0.6
0.8
1
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
metrics/l0
metrics/l0
0
20
40
60
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
sparsity/dead_features
sparsity/dead_features
0
0.05
0.1
0.15
0.2
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
details
1
losses
6
1-6 of 6
metrics
9
1-6 of 9
Add section