Skip to main content
eleutherai
Projects
neox
Reports
bf16 vs fp16
Log in
Sign up
Share
Comment
Star
Share
Comment
Star
bf16 vs fp16
on A100 x4 box
s black
Created on May 14
|
Last edited on May 14
Comment
Section 1
runtime/iteration_time
runtime/iteration_time
200
400
600
800
1k
Step
0.26
0.265
0.27
0.275
runtime/flops_per_sec_per_gpu
runtime/flops_per_sec_per_gpu
200
400
600
800
1k
Step
6.3e+13
6.4e+13
6.5e+13
6.6e+13
6.7e+13
runtime/samples_per_sec
runtime/samples_per_sec
200
400
600
800
1k
Step
58
59
60
61
62
Run set
2
Run set
2
Run set
2
Run set
2
Add a comment