Skip to main content
eleutherai
Projects
neox
Reports
Staged Seqlen Training 3
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
Staged Seqlen Training 3
s black
Created on May 20
|
Last edited on May 20
Comment
-
validation/lm_loss_by_wallclock_time
validation/lm_loss_by_wallclock_time
2
4
6
8
10
Time (hours)
3
3.5
4
4.5
validation/lm_loss_by_tokens
validation/lm_loss_by_tokens
1G
2G
3G
4G
5G
Step
3
3.5
4
4.5
validation/lm_loss
validation/lm_loss
2k
4k
6k
8k
10k
Step
3
4
validation/lm_loss_ppl
validation/lm_loss_ppl
2k
4k
6k
8k
10k
Step
20
40
60
80
100
120
140
Run set
11
Run set
11
Run set
11
Run set
11
Run set
11
Add a comment