Skip to main content

Kastan's group workspace

Timestamps visible
2022-06-21 18:18:21
made it to before use_pipeline
2022-06-21 18:18:21
made it to before if zero3
2022-06-21 18:18:21
made it to before build optimizer
2022-06-21 18:18:21
made it to before engine init
2022-06-21 18:18:21
[06/21/22 14:18:18] WARNING  colossalai - colossalai - WARNING:
2022-06-21 18:18:21
                             /u/kastan/.conda/envs/pytorch_1.11_colossal/lib/python3.8/site-packages/colossalai/initialize.py:304 initialize
2022-06-21 18:18:21
                    WARNING  colossalai - colossalai - WARNING: Initializing an non ZeRO model with optimizer class
2022-06-21 18:18:21
Watching model!
2022-06-21 18:18:21
[06/21/22 14:18:19] INFO     colossalai - colossalai - INFO: train_gpt.py:219 before_train
2022-06-21 18:18:21
                    INFO     colossalai - colossalai - INFO: training starts
2022-06-21 18:18:38
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 18:18:46
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 18:19:44
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 18:21:18
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 18:21:18
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 18:21:52
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 18:25:36
[06/21/22 14:25:34] INFO     colossalai - colossalai - INFO: train_gpt.py:222 after_train
2022-06-21 18:25:36
                    INFO     colossalai - colossalai - INFO: training finished