Skip to main content
aflah
Projects
rope-pct-exps
Reports
NeoX TE v/s Non-TE with NGC Container
Log in
Sign up
Share
Comment
Star
NeoX TE v/s Non-TE with NGC Container
Mohammad Aflah Khan
Created on July 11
|
Last edited on July 11
Comment
Section 1
runtime/tokens_per_sec
runtime/tokens_per_sec
100
200
300
400
500
Step
25000
30000
35000
1.1B-BS-32-No-TE-No-SLURM
1.1B-BS-32-No-SLURM
runtime/steps_per_sec
runtime/steps_per_sec
100
200
300
400
500
Step
0.16
0.18
0.2
0.22
0.24
0.26
0.28
0.3
1.1B-BS-32-No-TE-No-SLURM
1.1B-BS-32-No-SLURM
runtime/samples_per_sec
runtime/samples_per_sec
100
200
300
400
500
Step
12
14
16
18
1.1B-BS-32-No-TE-No-SLURM
1.1B-BS-32-No-SLURM
runtime/model_flops_utilization
runtime/model_flops_utilization
100
200
300
400
500
Step
12
14
16
18
1.1B-BS-32-No-TE-No-SLURM
1.1B-BS-32-No-SLURM
runtime/iteration_time
runtime/iteration_time
100
200
300
400
500
Step
3.5
4
4.5
5
5.5
6
1.1B-BS-32-No-TE-No-SLURM
1.1B-BS-32-No-SLURM
runtime/hardware_flops_utilization
runtime/hardware_flops_utilization
100
200
300
400
500
Step
14
16
18
20
22
24
1.1B-BS-32-No-TE-No-SLURM
1.1B-BS-32-No-SLURM
Run set
2
Run set
2
Run set
2
Add a comment