Skip to main content
ai2-llm
Projects
olmoe
Reports
Plot: AdamW eps

Plot: AdamW eps

Niklas Muennighoff
Created on June 27|Last edited on August 29

10k20k30k40k50kStep2.72.82.933.13.23.3
olmoe17-8x1b-final-eps Run set
olmoe17-8x1b-final-eps Run set
olmoe17-8x1b-final-norm Run set
olmoe17-8x1b-final-norm Run set
10k20k30k40k50kStep46810
olmoe17-8x1b-final-eps Run set
olmoe17-8x1b-final-eps Run set
olmoe17-8x1b-final-norm Run set
olmoe17-8x1b-final-norm Run set
olmoe17-8x1b-final-norm Run set
Run set
5
Run set 2


Created with ❤️ on Weights & Biases.

https://wandb.ai/ai2-llm/olmoe/reports/Plot-AdamW-eps--Vmlldzo4NDc5MDg0
Made with Weights & Biases. Sign up or log in to create reports like this one.