Skip to main content
eleutherai
Projects
mesh-transformer-jax
Reports
Does fixing clip by global norm fix MP?
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
Does fixing clip by global norm fix MP?
Ben Wang
Created on March 23
|
Last edited on March 23
Comment
Section 1
val/loss
val/loss
0
10k
20k
30k
40k
50k
Step
4
6
8
10
train/loss
train/loss
0
10k
20k
30k
40k
50k
Step
2
4
6
8
10
Run set
5
Run set
2
Add a comment