Skip to main content
homebrewnlp
Projects
gpt
Reports
Loss/Median256 (22/10/19 11:03:47)

Loss/Median256 (22/10/19 11:03:47)

Lucas Nestler
Created on October 19|Last edited on October 19

20k40k60k80kStep12345
group: more-norm
group: tied-moe-modulo
Run set
16


Created with ❤️ on Weights & Biases.

https://wandb.ai/homebrewnlp/gpt/reports/Loss-Median256-22-10-19-11-03-47---VmlldzoyODE3NDUx
Made with Weights & Biases. Sign up or log in to create reports like this one.