Skip to main content
ai2-llm
Projects
olmoe
Reports
OLMoE-1B-7B-0924 MC
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
OLMoE-1B-7B-0924 MC
David Heineman
Created on May 28
|
Last edited on May 28
Comment
Weighted Avg MMLU MC
Weighted Avg MMLU MC
200k
400k
600k
800k
1M
1.2M
Step
0.2
0.25
0.3
0.35
0.4
0.45
0.5
olmoe-8x1b-newhp-newds-final-annealFrom1200000
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
Weighted Avg MMLU MC
Weighted Avg MMLU MC
1T
2T
3T
4T
5T
throughput/total_tokens
0.2
0.25
0.3
0.35
0.4
0.45
0.5
olmoe-8x1b-newhp-newds-final-annealFrom1200000
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
olmoe-8x1b-newhp-newds-final
Run set
7
Add a comment