Skip to main content
a_man_chooses
Projects
palm
Reports
loss (23/05/10 17:38:27)

loss (23/05/10 17:38:27)

Enrico Shippole
Created on May 10|Last edited on May 10

050k100k150k200k250k300kStep246810
worldly-aardvark-335
1B_1e-5_betas-90-98_lion
1B_2e-5_betas-90-98_lion
1B_3e-5_betas-90-98_lion
1B_3e-4_eps-1e-8_betas-90-95_adamw
Run set
6


Created with ❤️ on Weights & Biases.

https://wandb.ai/a_man_chooses/palm/reports/loss-23-05-10-17-38-27---Vmlldzo0MzI0NTMx
Made with Weights & Biases. Sign up or log in to create reports like this one.