Skip to main content
a_man_chooses
Projects
palm
Reports
loss (23/05/06 10:15:16)

loss (23/05/06 10:15:16)

Enrico Shippole
Created on May 6|Last edited on May 6

010k20k30k40k50kStep246810
PaLM_150m_8k_no_qk_norm_b384_6e-4
Run: PaLM_150m_8k_no_qk_norm_b384_6e-4
1


Created with ❤️ on Weights & Biases.

https://wandb.ai/a_man_chooses/palm/reports/loss-23-05-06-10-15-16---Vmlldzo0Mjc5ODQ5
Made with Weights & Biases. Sign up or log in to create reports like this one.