Skip to main content

Kastan's group workspace

Timestamps visible
2022-06-21 15:01:50
Build model...
2022-06-21 15:01:50
made it to before use_pipeline
2022-06-21 15:01:52
made it to before if zero3
2022-06-21 15:01:52
made it to before build optimizer
2022-06-21 15:01:52
made it to before engine init
2022-06-21 15:01:52
[06/21/22 11:01:50] WARNING  colossalai - colossalai - WARNING:
2022-06-21 15:01:52
                             /u/kastan/.conda/envs/pytorch_1.11_colossal/lib/python3.8/site-packages/colossalai/initialize.py:304 initialize
2022-06-21 15:01:52
                    WARNING  colossalai - colossalai - WARNING: Initializing an non ZeRO model with optimizer class
2022-06-21 15:01:52
Watching model!
2022-06-21 15:01:52
                    INFO     colossalai - colossalai - INFO: train_gpt.py:216 before_train
2022-06-21 15:01:52
                    INFO     colossalai - colossalai - INFO: training starts
2022-06-21 15:02:02
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:03:28
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:05:28
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:06:24
[06/21/22 11:06:22] INFO     colossalai - colossalai - INFO: train_gpt.py:219 after_train
2022-06-21 15:06:24
                    INFO     colossalai - colossalai - INFO: training finished