Skip to main content

Igoro's group workspace

Timestamps visible
2021-11-03 23:15:58
make: Entering directory '/home/mchorse/gpt-neox/megatron/data'
2021-11-03 23:15:58
g++ -O3 -Wall -shared -std=c++11 -fPIC -fdiagnostics-color -I/usr/include/python3.8 -I/usr/local/lib/python3.8/dist-packages/pybind11/include helpers.cpp -o helpers.cpython-38-x86_64-linux-gnu.so
2021-11-03 23:16:05
make: Leaving directory '/home/mchorse/gpt-neox/megatron/data'
2021-11-03 23:16:07
Traceback (most recent call last):
2021-11-03 23:16:07
  File "/home/mchorse/gpt-neox/megatron/training.py", line 317, in get_optimizer
2021-11-03 23:16:07
    import bitsandbytes as bnb
2021-11-03 23:16:07
ModuleNotFoundError: No module named 'bitsandbytes'
2021-11-03 23:16:07
During handling of the above exception, another exception occurred:
2021-11-03 23:16:07
Traceback (most recent call last):
2021-11-03 23:16:07
  File "train.py", line 27, in <module>
2021-11-03 23:16:07
    pretrain(neox_args=neox_args)
2021-11-03 23:16:07
  File "/home/mchorse/gpt-neox/megatron/training.py", line 82, in pretrain
2021-11-03 23:16:07
    model, optimizer, lr_scheduler = setup_model_and_optimizer(
2021-11-03 23:16:07
  File "/home/mchorse/gpt-neox/megatron/training.py", line 386, in setup_model_and_optimizer
2021-11-03 23:16:07
    optimizer, param_groups = get_optimizer(model=model, neox_args=neox_args)
2021-11-03 23:16:07
  File "/home/mchorse/gpt-neox/megatron/training.py", line 321, in get_optimizer
2021-11-03 23:16:07
    raise Exception
2021-11-03 23:16:07
Exception
2021-11-03 23:16:07
Please install bitsandbytes following https://github.com/facebookresearch/bitsandbytes.