Skip to main content
eleutherai-oslo
Projects
polyglot-ko-12_8b
Run groups
VAQ2z6LhjEqredn3VEp3Qp_nve6vwz2
Logs
Group
Workspace
Runs
Logs
Files
Artifacts

Eleutherai-oslo's group workspace

Timestamps visible
2023-04-20 01:24:13
[2023-04-20 01:24:11,538] [INFO] [distributed.py:46:init_distributed] Initializing torch distributed with backend: nccl
2023-04-20 01:24:13
FAILED !!!
2023-04-20 01:24:14
Traceback (most recent call last):
2023-04-20 01:24:14
  File "/fsx/polyglot.train/gpt-neox/train.py", line 27, in <module>
2023-04-20 01:24:14
    pretrain(neox_args=neox_args)
2023-04-20 01:24:14
  File "/fsx/polyglot.train/gpt-neox/megatron/training.py", line 104, in pretrain
2023-04-20 01:24:14
    model, optimizer, lr_scheduler = setup_model_and_optimizer(
2023-04-20 01:24:14
  File "/fsx/polyglot.train/gpt-neox/megatron/training.py", line 440, in setup_model_and_optimizer
2023-04-20 01:24:14
    optimizer, param_groups = get_optimizer(model=model, neox_args=neox_args)
2023-04-20 01:24:14
UnboundLocalError: local variable 'model' referenced before assignment