Skip to main content
eleutherai-oslo
Projects
polyglot-ko-12_8b
Run groups
bbmEhMAwoKq4TkRTSAByxf_srvwlu70
Logs
Overview
Workspace
Runs
Logs
Files
Artifacts

Eleutherai-oslo's group workspace

Timestamps visible
2023-04-20 02:35:40
[2023-04-20 02:35:37,947] [INFO] [distributed.py:46:init_distributed] Initializing torch distributed with backend: nccl
2023-04-20 02:35:40
make: Entering directory '/fsx/polyglot.train/gpt-neox/megatron/data'
2023-04-20 02:35:40
make: Nothing to be done for 'default'.
2023-04-20 02:35:40
make: Leaving directory '/fsx/polyglot.train/gpt-neox/megatron/data'
2023-04-20 02:35:40
[2023-04-20 02:35:39,703] [WARNING] [config.py:77:_sanity_check] DeepSpeedConfig: cpu_offload is deprecated. Please use offload_optimizer.
2023-04-20 02:35:40
/fsx/kevin.ai/Anaconda/envs/polyglot/lib/python3.9/site-packages/torch/distributed/distributed_c10d.py:429: UserWarning: torch.distributed.distributed_c10d._get_global_rank is deprecated please use torch.distributed.distributed_c10d.get_global_rank instead
2023-04-20 02:35:40
  warnings.warn(