Skip to main content
homebrewnlp
Projects
gpt
Reports
Loss/Median64 vs Tokens (22/10/22 06:25:21)

Loss/Median64 vs Tokens (22/10/22 06:25:21)

Lucas Nestler
Created on October 22|Last edited on October 22

20G40G60G80G100GSpeed/Tokens Seen0.70.750.80.850.90.95
group: tied-moe-modulo
Run set
13


Created with ❤️ on Weights & Biases.

https://wandb.ai/homebrewnlp/gpt/reports/Loss-Median64-vs-Tokens-22-10-22-06-25-21---VmlldzoyODMzNjAx
Made with Weights & Biases. Sign up or log in to create reports like this one.