Skip to main content
ai2-llm
Projects
olmoe
Reports
OLMoE 8x1B vs Amberish OLMo 1B

OLMoE 8x1B vs Amberish OLMo 1B

Niklas Muennighoff
Created on July 12|Last edited on August 29

200k400k600k800k1M1.2MStep2.62.72.82.93
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final-wrongepochvalue Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
0200k400k600k800k1M1.2MStep22.22.42.62.8
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final-wrongepochvalue Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
Run set
6
Run set 2


Created with ❤️ on Weights & Biases.

https://wandb.ai/ai2-llm/olmoe/reports/OLMoE-8x1B-vs-Amberish-OLMo-1B--Vmlldzo4NjU1NDIy
Made with Weights & Biases. Sign up or log in to create reports like this one.