Skip to main content
eleutherai
Projects
gpt-thicc
Run groups
20B_pretrain
Workspace
Log in
Sign up
Overview
Workspace
Runs
Logs
Files
Artifacts
Igoro's group workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Group: 20B_pretrain
Name
144 visualized
new-8-0
new-8-0
new-2-0
new-2-0
new-10-0
new-10-0
new-9-0
new-9-0
new-5-0
new-5-0
new-3-0
new-3-0
new-7-0
new-7-0
new-6-0
new-6-0
new-11-0
new-11-0
new-4-0
new-4-0
new-0-0
new-0-0
new-1-0
new-1-0
new-3-0
new-3-0
new-5-0
new-5-0
new-7-0
new-7-0
new-9-0
new-9-0
new-2-0
new-2-0
new-4-0
new-4-0
new-10-0
new-10-0
new-11-0
new-11-0
1-20
of 144
Settings
Add panels
runtime
3
runtime/samples_per_sec
runtime/samples_per_sec
Showing first 10 runs
40k
60k
80k
100k
120k
140k
Step
10
15
20
25
30
35
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
runtime/iteration_time
runtime/iteration_time
Showing first 10 runs
40k
60k
80k
100k
120k
140k
Step
40
60
80
100
120
140
160
180
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
runtime/flops_per_sec_per_gpu
runtime/flops_per_sec_per_gpu
Showing first 10 runs
40k
60k
80k
100k
120k
140k
Step
4e+13
6e+13
8e+13
1e+14
1.2e+14
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
train
3
train/learning_rate
train/learning_rate
Showing first 10 runs
40k
60k
80k
100k
120k
140k
Step
0.00002
0.00004
0.00006
0.00008
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
train/loss_scale
train/loss_scale
Showing first 10 runs
40k
60k
80k
100k
120k
140k
Step
200000
400000
600000
800000
1000000
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
train/lm_loss
train/lm_loss
Showing first 10 runs
40k
60k
80k
100k
120k
140k
Step
1.6
1.8
2
2.2
2.4
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
new-0-0
validation
2
System
15
1-6 of 15
Add section