Skip to main content
ai2-llm
Projects
olmoe
Reports
Plot: LBL vs No LBL
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
Plot: LBL vs No LBL
Niklas Muennighoff
Created on August 11
|
Last edited on September 1
Comment
eval/v3-small-c4_en-validation/CrossEntropyLoss
eval/v3-small-c4_en-validation/CrossEntropyLoss
5k
10k
15k
Step
2.5
3
3.5
4
4.5
5
OLMoE-8DE-NLB
OLMoE-8DE
train/CrossEntropyLoss
train/CrossEntropyLoss
5k
10k
15k
Step
2
3
4
5
6
OLMoE-8DE-NLB
OLMoE-8DE
Run set
2
Add a comment