Skip to main content
smangrul
Projects
DDP_vs_DeepSpeed_cls_task
Log in
Sign up
Overview
Workspace
Runs
Automat.
Sweeps
Reports
Artifacts
Smangrul's workspace
Personal workspace
Automated workspace
Changes are only visible to you.
Runs
2
Name
2 visualized
no_deepspeed
no_deepspeed
deepspeed_zero_stage2
deepspeed_zero_stage2
1-2
of 2
Settings
Add panels
Charts
8
1-8 of 8
accuracy.f1
accuracy.f1
100
200
300
400
500
600
Step
0.89
0.9
0.91
0.92
0.93
no_deepspeed
deepspeed_zero_stage2
accuracy.accuracy
accuracy.accuracy
100
200
300
400
500
600
Step
0.84
0.86
0.88
0.9
no_deepspeed
deepspeed_zero_stage2
train_loss
train_loss
100
200
300
400
500
600
Step
0.1
0.2
0.3
0.4
0.5
no_deepspeed
deepspeed_zero_stage2
GPU Memory Allocated (%)
GPU Memory Allocated (%)
50
100
150
200
250
300
350
Time (seconds)
0
20
40
60
80
100
no_deepspeed
GPU 0 Memory Allocated (%)
no_deepspeed
GPU 1 Memory Allocated (%)
deepspeed_zero_stage2
GPU 0 Memory Allocated (%)
deepspeed_zero_stage2
GPU 1 Memory Allocated (%)
GPU Utilization (%)
GPU Utilization (%)
50
100
150
200
250
300
350
Time (seconds)
0
20
40
60
80
100
no_deepspeed
GPU 0 Utilization (%)
no_deepspeed
GPU 1 Utilization (%)
deepspeed_zero_stage2
GPU 0 Utilization (%)
deepspeed_zero_stage2
GPU 1 Utilization (%)
CPU Utilization (%)
CPU Utilization (%)
50
100
150
200
250
300
350
Time (seconds)
0
20
40
60
80
100
no_deepspeed
deepspeed_zero_stage2
System
18
1-6 of 18
Add section