Skip to main content
eleutherai
Projects
mesh-transformer-jax
Reports
rope go brrr

rope go brrr

Leo Gao
Created on May 1|Last edited on May 1

Section 1


20k40k60k80kStep0.330.340.350.36
20k40k60k80kStep0.50.520.540.560.580.6
20k40k60k80kStep0.320.340.360.38
Run set
15



Run set
15



Run set
15



Run set
15



Run set
15



Run set
15






Run set
15





Run set
15






Run set
15




Run set
15





Run set
15




Run set
15




Run set
15


Created with ❤️ on Weights & Biases.

https://wandb.ai/eleutherai/mesh-transformer-jax/reports/rope-go-brrr--Vmlldzo2NTQ5MDc
Made with Weights & Biases. Sign up or log in to create reports like this one.