Skip to main content
neilus
Projects
zenn-1gpu-deepspeed-ZeRO
Log in
Sign up
Project
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts
Neilus's workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Runs
14
Name
14 visualized
exp004_no_deepspeed
exp004_no_deepspeed
exp005_no_deepspeed_gradient_checkpointng
exp005_no_deepspeed_gradient_checkpointng
exp006_ZeRO-0
exp006_ZeRO-0
exp007_ZeRO-1
exp007_ZeRO-1
exp008_ZeRO-1_offload_optimizer
exp008_ZeRO-1_offload_optimizer
exp009_ZeRO-1_gradient_checkpointng
exp009_ZeRO-1_gradient_checkpointng
exp010_ZeRO-1_gradient_checkpointng_offload_optimizer
exp010_ZeRO-1_gradient_checkpointng_offload_optimizer
exp011_ZeRO-2
exp011_ZeRO-2
exp012_ZeRO-2_offload_optimizer
exp012_ZeRO-2_offload_optimizer
exp013_ZeRO-2_gradient_checkpointng
exp013_ZeRO-2_gradient_checkpointng
exp014_ZeRO-2_gradient_checkpointng_offload_optimizer
exp014_ZeRO-2_gradient_checkpointng_offload_optimizer
exp015_ZeRO-3_gradient_checkpointng
exp015_ZeRO-3_gradient_checkpointng
exp016_ZeRO-3_gradient_checkpointng_offload_param
exp016_ZeRO-3_gradient_checkpointng_offload_param
exp017_ZeRO-3_gradient_checkpointng_offload_optimizer_param
exp017_ZeRO-3_gradient_checkpointng_offload_optimizer_param
1-14
of 14
Previous
Next
train/learning_rate
train/learning_rate
0
20
40
60
80
100
120
Step
0
0.00002
0.00004
0.00006
0.00008
exp005_no_deepspeed_gradient_checkpointng
exp006_ZeRO-0
exp007_ZeRO-1
exp008_ZeRO-1_offload_optimizer
exp009_ZeRO-1_gradient_checkpointng
exp010_ZeRO-1_gradient_checkpointng_offload_optimizer
exp011_ZeRO-2
exp012_ZeRO-2_offload_optimizer
exp013_ZeRO-2_gradient_checkpointng
exp014_ZeRO-2_gradient_checkpointng_offload_optimizer
exp015_ZeRO-3_gradient_checkpointng
exp016_ZeRO-3_gradient_checkpointng_offload_param
exp017_ZeRO-3_gradient_checkpointng_offload_optimizer_param