Skip to main content
kastan
Projects
col_ai
Run groups
gpt2_2d
Logs
Group
Workspace
Runs
Logs
Files
Artifacts

Kastan's group workspace

Timestamps visible
2022-06-21 15:24:44
made it to before if zero3
2022-06-21 15:24:44
made it to before build optimizer
2022-06-21 15:24:44
made it to before engine init
2022-06-21 15:24:44
[06/21/22 11:24:42] WARNING  colossalai - colossalai - WARNING:
2022-06-21 15:24:44
                             /u/kastan/.conda/envs/pytorch_1.11_colossal/lib/python3.8/site-packages/colossalai/initialize.py:304 initialize
2022-06-21 15:24:44
                    WARNING  colossalai - colossalai - WARNING: Initializing an non ZeRO model with optimizer class
2022-06-21 15:24:44
Watching model!
2022-06-21 15:24:44
                    INFO     colossalai - colossalai - INFO: train_gpt.py:219 before_train
2022-06-21 15:24:44
                    INFO     colossalai - colossalai - INFO: training starts
2022-06-21 15:27:23
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:28:07
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:29:15
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:31:27
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:32:10
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:32:44
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:33:22
Error when collecting samples_per_sec, Tflops... not enough values to unpack (expected 2, got 1)
2022-06-21 15:33:27
[06/21/22 11:33:26] INFO     colossalai - colossalai - INFO: train_gpt.py:222 after_train
2022-06-21 15:33:27
                    INFO     colossalai - colossalai - INFO: training finished