Skip to main content
ai2-llm
Projects
olmoe
Reports
Plot: Expert sharing

Plot: Expert sharing

Niklas Muennighoff
Created on August 4|Last edited on August 29

5k10k15k20k25k30kStep2.62.833.23.43.63.8
olmoe-8x1b-newhp-newds-cx5-fine-shared Run set
olmoe-8x1b-newhp-newds-cx5-fine-shared Run set
olmoe-8x1b-newhp-newds-cx5-fine-shared Run set
olmoe-8x1b-newhp-newds-cx5-fine-shared Run set
olmoe-8x1b-newhp-newds-cx5-fine Run set
olmoe-8x1b-newhp-newds-cx5-fine Run set
5k10k15k20k25k30kStep23456
olmoe-8x1b-newhp-newds-cx5-fine-shared Run set
olmoe-8x1b-newhp-newds-cx5-fine-shared Run set
olmoe-8x1b-newhp-newds-cx5-fine-shared Run set
olmoe-8x1b-newhp-newds-cx5-fine-shared Run set
olmoe-8x1b-newhp-newds-cx5-fine Run set
olmoe-8x1b-newhp-newds-cx5-fine Run set
Run set
6
Run set 2


Created with ❤️ on Weights & Biases.

https://wandb.ai/ai2-llm/olmoe/reports/Plot-Expert-sharing--Vmlldzo4OTIyMjQz
Made with Weights & Biases. Sign up or log in to create reports like this one.