Skip to main content
a_man_chooses
Projects
palm
Reports
loss (23/05/03 14:04:43)

loss (23/05/03 14:04:43)

Enrico Shippole
Created on May 3|Last edited on May 3

010k20k30k40k50k60k70kStep246810
PaLM_1B_8k_no-qk-norm_b288_3e-4
Run: PaLM_1B_8k_no-qk-norm_b288_3e-4
1


Created with ❤️ on Weights & Biases.

https://wandb.ai/a_man_chooses/palm/reports/loss-23-05-03-14-04-43---Vmlldzo0MjUxNjgz
Made with Weights & Biases. Sign up or log in to create reports like this one.