Skip to main content
jbloom
Projects
mats_sae_training_gpt2_small_resid_pre_5
Workspace
Log in
Sign up
Overview
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts
Jbloom's workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Runs
21
Name
13 visualized
L0-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L0-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L1-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L1-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L2-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L2-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L3-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L3-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L4-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L4-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L5-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L5-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L6-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L6-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L7-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L7-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L8-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L8-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L9-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L9-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L10-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L10-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L11-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L11-24576-L1-8e-05-LR-0.0004-Tokens-3.000e+08
L12-24576-L1-4e-05-LR-0.0004-Tokens-3.000e+08
L12-24576-L1-4e-05-LR-0.0004-Tokens-3.000e+08
1-13
of 13
Settings
Add panels
Panel Section
9
1-8 of 9
metrics/CE_loss_score and hook_point_layer v. metrics/explained_variance
metrics/CE_loss_score and hook_point_layer v. metrics/explained_variance
0
2
4
6
8
10
hook_point_layer
0.90
0.92
0.94
0.96
0.98
1.00
metrics/explained_variance
0.9
0.92
0.94
0.96
0.98
1
metrics/CE_loss_score
metrics/CE_loss_score v. metrics/l0
metrics/CE_loss_score v. metrics/l0
20
40
60
80
100
metrics/l0
0.8
0.85
0.9
0.95
metrics/CE_loss_score
metrics/explained_variance
metrics/explained_variance
0.9
0.95
1
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
losses/mse_loss
losses/mse_loss
0
0.005
0.01
0.015
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
losses/l1_loss
losses/l1_loss
0
100
200
300
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
metrics/CE_loss_score
metrics/CE_loss_score
0.6
0.8
1
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
metrics/l0
metrics/l0
0
20
40
60
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
sparsity/dead_features
sparsity/dead_features
0
0.05
0.1
0.15
0.2
0
0
1
1
2
2
3
3
4
4
5
5
6
6
7
7
8
8
9
9
10
10
11
11
11
11
details
1
losses
6
1-6 of 6
metrics
9
1-6 of 9
Add section