Skip to main content
marin-community
Projects
marin
Reports
Exp942: MegaMath Annealing
Log in
Sign up
Share
Comment
Star
Exp942: MegaMath Annealing
David Leo Wright Hall
Created on May 26
|
Last edited on May 27
Comment
Running default anneal with phoenix checkpoint on megamath.
Will add new plots as it makes more progress
Section 1
eval/ema/paloma/bpb, eval/paloma/bpb
eval/ema/paloma/bpb, eval/paloma/bpb
throughput/total_tokens
1
2
marin-8b-anneal-megamath-all
eval/ema/paloma/bpb
marin-8b-anneal-megamath-all
eval/paloma/bpb
marin-8b-anneal-megamath-real-dclm
eval/ema/paloma/bpb
marin-8b-anneal-megamath-real-dclm
eval/paloma/bpb
marin-8b-anneal-megamath-control
eval/ema/paloma/bpb
marin-8b-anneal-megamath-control
eval/paloma/bpb
Run set
21
Add a comment