Skip to main content
neilus
Projects
zenn-1gpu-deepspeed-ZeRO
Workspace
Log in
Sign up
Project
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts
Neilus's workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Runs
14
Name
14 visualized
exp004_no_deepspeed
exp004_no_deepspeed
exp005_no_deepspeed_gradient_checkpointng
exp005_no_deepspeed_gradient_checkpointng
exp006_ZeRO-0
exp006_ZeRO-0
exp007_ZeRO-1
exp007_ZeRO-1
exp008_ZeRO-1_offload_optimizer
exp008_ZeRO-1_offload_optimizer
exp009_ZeRO-1_gradient_checkpointng
exp009_ZeRO-1_gradient_checkpointng
exp010_ZeRO-1_gradient_checkpointng_offload_optimizer
exp010_ZeRO-1_gradient_checkpointng_offload_optimizer
exp011_ZeRO-2
exp011_ZeRO-2
exp012_ZeRO-2_offload_optimizer
exp012_ZeRO-2_offload_optimizer
exp013_ZeRO-2_gradient_checkpointng
exp013_ZeRO-2_gradient_checkpointng
exp014_ZeRO-2_gradient_checkpointng_offload_optimizer
exp014_ZeRO-2_gradient_checkpointng_offload_optimizer
exp015_ZeRO-3_gradient_checkpointng
exp015_ZeRO-3_gradient_checkpointng
exp016_ZeRO-3_gradient_checkpointng_offload_param
exp016_ZeRO-3_gradient_checkpointng_offload_param
exp017_ZeRO-3_gradient_checkpointng_offload_optimizer_param
exp017_ZeRO-3_gradient_checkpointng_offload_optimizer_param
1-14
of 14
Previous
Next
train/grad_norm
train/grad_norm
0
20
40
60
80
100
120
Step
0.1
0.2
0.3
0.4
exp005_no_deepspeed_gradient_checkpointng
exp006_ZeRO-0
exp007_ZeRO-1
exp008_ZeRO-1_offload_optimizer
exp009_ZeRO-1_gradient_checkpointng
exp010_ZeRO-1_gradient_checkpointng_offload_optimizer
exp011_ZeRO-2
exp012_ZeRO-2_offload_optimizer
exp013_ZeRO-2_gradient_checkpointng
exp014_ZeRO-2_gradient_checkpointng_offload_optimizer
exp015_ZeRO-3_gradient_checkpointng
exp016_ZeRO-3_gradient_checkpointng_offload_param
exp017_ZeRO-3_gradient_checkpointng_offload_optimizer_param