Skip to main content
kastan
Projects
col_ai
Run groups
Jul-27__15:25
Logs
Group
Workspace
Runs
Logs
Files
Artifacts

Kastan's group workspace

Timestamps visible
2022-07-27 20:29:06
  File "/u/kastanday/.conda/envs/nice_base/envs/col_ai_old_v5/lib/python3.9/site-packages/colossalai/engine/schedule/_non_pipeline_schedule.py", line 83, in forward_backward_step
2022-07-27 20:29:06
    engine.backward(loss)
2022-07-27 20:29:06
  File "/u/kastanday/.conda/envs/nice_base/envs/col_ai_old_v5/lib/python3.9/site-packages/colossalai/engine/_base_engine.py", line 163, in backward
2022-07-27 20:29:06
    ret = self.optimizer.backward(loss)
2022-07-27 20:29:06
  File "/u/kastanday/.conda/envs/nice_base/envs/col_ai_old_v5/lib/python3.9/site-packages/colossalai/engine/gradient_accumulation/_gradient_accumulation.py", line 94, in backward
2022-07-27 20:29:06
    self.optim.backward(scaled_loss)
2022-07-27 20:29:06
  File "/u/kastanday/.conda/envs/nice_base/envs/col_ai_old_v5/lib/python3.9/site-packages/colossalai/amp/naive_amp/naive_amp.py", line 37, in backward
2022-07-27 20:29:06
    self.optim.backward(loss)
2022-07-27 20:29:06
  File "/u/kastanday/.conda/envs/nice_base/envs/col_ai_old_v5/lib/python3.9/site-packages/colossalai/amp/naive_amp/_fp16_optimizer.py", line 289, in backward
2022-07-27 20:29:06
    scaled_loss.backward()
2022-07-27 20:29:06
  File "/u/kastanday/.conda/envs/nice_base/envs/col_ai_old_v5/lib/python3.9/site-packages/torch/_tensor.py", line 396, in backward
2022-07-27 20:29:06
    torch.autograd.backward(self, gradient, retain_graph, create_graph, inputs=inputs)
2022-07-27 20:29:06
  File "/u/kastanday/.conda/envs/nice_base/envs/col_ai_old_v5/lib/python3.9/site-packages/torch/autograd/__init__.py", line 173, in backward
2022-07-27 20:29:06
    Variable._execution_engine.run_backward(  # Calls into the C++ engine to run the backward pass
2022-07-27 20:29:06
KeyboardInterrupt