Skip to main content
ai2-llm
Projects
olmoe
Reports
Plot: Shared vs Dense

Plot: Shared vs Dense

Niklas Muennighoff
Created on June 23|Last edited on August 29

Red/23515: Shared ; Green/23520: Dense

20k40k60k80k100k120k140kStep33.544.55
23520 Run set
23515 Run set
20k40k60k80k100k120k140kStep46810
23520 Run set
23515 Run set
Run set
2
Run set 2


Created with ❤️ on Weights & Biases.

https://wandb.ai/ai2-llm/olmoe/reports/Plot-Shared-vs-Dense--Vmlldzo4NDI0MTc5
Made with Weights & Biases. Sign up or log in to create reports like this one.