Skip to main content
ai2-llm
Projects
olmoe
Reports
New tokenizer
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
New tokenizer
Niklas Muennighoff
Created on July 25
|
Last edited on August 29
Comment
eval/c4_en-validation/CrossEntropyLoss
eval/c4_en-validation/CrossEntropyLoss
5k
10k
15k
20k
25k
30k
Step
2.5
3
3.5
4
4.5
olmoe-8x1b-newhp-newds-cx5-fine1-newtok
Run set
olmoe-8x1b-newhp-newds-cx5-fine1-datafix
Run set
train/CrossEntropyLoss
train/CrossEntropyLoss
5k
10k
15k
20k
25k
30k
Step
2
3
4
5
6
olmoe-8x1b-newhp-newds-cx5-fine1-newtok
Run set
olmoe-8x1b-newhp-newds-cx5-fine1-datafix
Run set
Run set
2
Run set 2
Add a comment