Skip to main content
eleutherai
Projects
neox
Reports
350M Param Model Training
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
350M Param Model Training
s black
Created on May 20
|
Last edited on May 20
Comment
Section 1
validation/lm_loss_by_wallclock_time
validation/lm_loss_by_wallclock_time
20
40
60
80
Time (hours)
2.5
3
3.5
validation/lm_loss_by_tokens
validation/lm_loss_by_tokens
50G
100G
150G
200G
250G
Step
2.5
3
3.5
validation/lm_loss
validation/lm_loss
100k
200k
300k
400k
500k
Step
3
validation/lm_loss_ppl
validation/lm_loss_ppl
100k
200k
300k
400k
500k
Step
10
20
30
40
50
Run set
8
Run set
8
Run set
8
Run set
8
Run set
8
Add a comment