Skip to main content
marin-community
Projects
marin
Reports
442 Dolma
Log in
Sign up
Share
Comment
Star
442 Dolma
David Leo Wright Hall
Created on October 17
|
Last edited on May 12
Comment
Just testing the infrastructure
Plots
throughput/mfu
throughput/mfu
20k
40k
60k
Step
48
50
52
54
dolma-1.4b-929041
log(train/loss) vs tokens
log(train/loss) vs tokens
50G
100G
150G
200G
250G
300G
throughput/total_tokens
3
4
5
6
7
8
dolma-1.4b-929041
Run set
1
Add a comment