Skip to main content
marin-community
Projects
marin
Reports
Olmo 7b SFT Run
Log in
Sign up
Share
Comment
Star
Olmo 7b SFT Run
Reproduced Olmo 7b SFT with the following hyperparameters: Batch
Ahmed Mohamed Ahmed
Created on November 15
|
Last edited on November 21
Comment
optim/learning_rate
optim/learning_rate
0
200
400
600
800
Step
0
5e-7
0.000001
0.0000015
olmo7_072024_sft_4096_debugtoken_final-a92a4b
train/loss
train/loss
0
200
400
600
800
Step
0.8
1
1.2
1.4
olmo7_072024_sft_4096_debugtoken_final-a92a4b
Run set
1
Add a comment