Skip to main content
ai2-llm
Projects
olmoe
Reports
OLMoE 8x1B vs Peteish OLMo 7B

OLMoE 8x1B vs Peteish OLMo 7B

Niklas Muennighoff
Created on July 31|Last edited on August 29

200k400k600k800k1M1.2MStep22.22.42.62.83
olmoe-8x1b-newhp-newds-final-annealFrom1200000 Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final-fail Run set
olmoe-8x1b-newhp-newds-final-wrongepochvalue Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
0200k400k600k800k1M1.2MStep22.22.42.62.83
olmoe-8x1b-newhp-newds-final-annealFrom1200000 Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final-fail Run set
olmoe-8x1b-newhp-newds-final-wrongepochvalue Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
olmoe-8x1b-newhp-newds-final Run set
Run set
9
Run set 3


Created with ❤️ on Weights & Biases.

https://wandb.ai/ai2-llm/olmoe/reports/OLMoE-8x1B-vs-Peteish-OLMo-7B--Vmlldzo4ODgxMzMx
Made with Weights & Biases. Sign up or log in to create reports like this one.