GPU usage FP16 vs FP32

Comparison between the gpu memory usage while training CNNs in FP16 and FP32 settings

Created on July 30|Last edited on July 30

Comment

﻿
Memory Utilisation﻿
device_id: 0/memory.used (MB)
device_id: 0/memory.used (MB)
05101520Step2000400060008000100001200014000
fp16-plOne-Bs30096
fp16-plOne-Bs29096
fp16-plOne-Bs28096
fp32-plOne-Bs16096
fp16-plOne-Bs16096
fp32-plOne-Bs15096
fp16-plOne-Bs15096
device_id: 0/utilization.memory (%)
device_id: 0/utilization.memory (%)
05101520Step01020304050
fp16-plOne-Bs30096
fp16-plOne-Bs29096
fp16-plOne-Bs28096
fp32-plOne-Bs16096
fp16-plOne-Bs16096
fp32-plOne-Bs15096
fp16-plOne-Bs15096
device_id: 0/utilization.gpu (%)
device_id: 0/utilization.gpu (%)
05101520Step020406080100
fp16-plOne-Bs30096
fp16-plOne-Bs29096
fp16-plOne-Bs28096
fp32-plOne-Bs16096
fp16-plOne-Bs16096
fp32-plOne-Bs15096
fp16-plOne-Bs15096
Run set7
﻿
GPU Stats﻿
Run set7
﻿
Model﻿
Batch Size : 128
	
﻿

Add a comment