eleutherai

Preetham-gali's group workspace

Group: 6cg52sCUpLsMg4UNerGbQJ_2jcbn8z1

2179

1-3

of 3

Timestamps visible

2021-08-27 06:09:50

[2021-08-27 06:09:48,544] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 16777216.0, reducing to 8388608.0

2021-08-27 06:09:57

[2021-08-27 06:09:55,905] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 8388608.0, reducing to 4194304.0

2021-08-27 06:10:05

[2021-08-27 06:10:03,401] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 4194304.0, reducing to 2097152.0

2021-08-27 06:10:13

[2021-08-27 06:10:11,197] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 2097152.0, reducing to 1048576.0

2021-08-27 06:10:20

[2021-08-27 06:10:18,527] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 1048576.0, reducing to 524288.0

2021-08-27 06:10:27

[2021-08-27 06:10:25,868] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 524288.0, reducing to 262144.0

2021-08-27 06:10:35

[2021-08-27 06:10:33,227] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 262144.0, reducing to 131072.0

2021-08-27 06:10:42

[2021-08-27 06:10:40,480] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 131072.0, reducing to 65536.0

2021-08-27 06:10:49

[2021-08-27 06:10:47,912] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 65536.0, reducing to 32768.0

2021-08-27 06:10:57

[2021-08-27 06:10:55,335] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 32768.0, reducing to 16384.0

2021-08-27 06:11:04

[2021-08-27 06:11:02,869] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 16384.0, reducing to 8192.0

2021-08-27 07:27:43

[2021-08-27 07:27:41,768] [INFO] [stage1.py:695:step] [deepspeed] fp16 dynamic loss scale overflow! Skipping step. Attempted loss scale: 8192.0, reducing to 4096.0