Skip to main content
ai2-llm
Projects
olmoe
Reports
Plot: Decay LN

Plot: Decay LN

Niklas Muennighoff
Created on June 25|Last edited on August 29

50k100k150k200kStep2.72.752.82.852.9
olmoe17-8x1b-final-normdc Run set
olmoe17-8x1b-final-eps Run set
olmoe17-8x1b-final-eps Run set
100k200k300k400kStep46810
olmoe17-8x1b-final-normdc Run set
olmoe17-8x1b-final-eps Run set
olmoe17-8x1b-final-eps Run set
Run set
3
Run set 2


Created with ❤️ on Weights & Biases.

https://wandb.ai/ai2-llm/olmoe/reports/Plot-Decay-LN--Vmlldzo4NDQ1NDYy
Made with Weights & Biases. Sign up or log in to create reports like this one.