Skip to main content
furiousteabag
Projects
doppelganger
Workspace
Log in
Sign up
W&B will be performing maintenance on Saturday, Nov 22nd starting at 6:00 PM PST. The UI and API may be intermittently unavailable during this time. Thank you for your patience and visit https://status.wandb.com for updates.
Project
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts
Furiousteabag's workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Runs
9
Name
5 visualized
Full bs64 fix-fsdp
Full bs64 fix-fsdp
Full bs128 2x-data
Full bs128 2x-data
Full bs128 fixed-tokenizer2
Full bs128 fixed-tokenizer2
Full bs128 fixed-tokenizer
Full bs128 fixed-tokenizer
Full bs256
Full bs256
LoRA cosine0.03 2e-4 bs16 r32 a16
LoRA cosine0.03 2e-4 bs16 r32 a16
LoRA cosine0.3 2e-4 bs16 r16 a16
LoRA cosine0.3 2e-4 bs16 r16 a16
LoRA linear 2e-4 bs16 r16 a16
LoRA linear 2e-4 bs16 r16 a16
LoRA linear 3e-5 bs32 r16 a16
LoRA linear 3e-5 bs32 r16 a16
1-9
of 9
Previous
Next
train/learning_rate
train/learning_rate
0
200
400
600
Step
0
0.000005
0.00001
0.000015
0.00002
Full bs64 fix-fsdp
Full bs128 2x-data
Full bs128 fixed-tokenizer2
Full bs128 fixed-tokenizer
Full bs256