Skip to main content
eleutherai
Projects
mesh-transformer-jax
Reports
j2

j2

Leo Gao
Created on October 3|Last edited on October 8

Section 1


05k10k15k20kStep0.260.280.30.320.340.36
displayName: v2_6b_test_nogeglu hellaswag-v0/acc
displayName: v2_6b_test hellaswag-v0/acc
displayName: pile_j2_gpt2tok_rope hellaswag-v0/acc
displayName: GPT3_6B_pile_rotary hellaswag/acc
Run set
23


Created with ❤️ on Weights & Biases.

https://wandb.ai/eleutherai/mesh-transformer-jax/reports/j2--VmlldzoxMDgxMDE3
Made with Weights & Biases. Sign up or log in to create reports like this one.