Skip to main content
marin-community
Projects
optimizer-scaling
Reports
params/norm/transformer.layers.9.self_attn.v_proj.weight (25/11/22 21:59:05)
Log in
Sign up
Share
Comment
Star
params/norm/transformer.layers.9.self_attn.v_proj.weight (25/11/22 21:59:05)
Kaiyue Wen
Created on November 23
|
Last edited on November 23
Comment
params/norm/transformer.layers.9.self_attn.v_proj.weight
params/norm/transformer.layers.9.self_attn.v_proj.weight
0
20k
40k
60k
80k
Step
20
40
60
80
100
120
140
rerun_baseline-muon-130m-lr4.00e-3-cosine-wd0.1-370ba9
rerun_baseline-muon-130m-lr4.00e-3-cosine-fda4ea
Run set
2
Add a comment