eleutherai

Chilli's group workspace

Group: RDE4MmfNH7YyVbiYT2iHxA

105

107

101

105

109

105

109

107

105

101

105

101

105

388

1-18

of 18

Timestamps visible

2021-03-07 16:05:05

File "pretrain_gpt2.py", line 184, in <module>

2021-03-07 16:05:05

pretrain(train_valid_test_datasets_provider, model_provider, forward_step,

2021-03-07 16:05:05

File "/home/mchorse/gpt-neox/megatron/training.py", line 109, in pretrain

2021-03-07 16:05:05

iteration = train(forward_step_func,

2021-03-07 16:05:05

File "/home/mchorse/gpt-neox/megatron/training.py", line 109, in pretrain

2021-03-07 16:05:05

iteration = train(forward_step_func,

2021-03-07 16:05:05

File "/home/mchorse/gpt-neox/megatron/training.py", line 558, in train

2021-03-07 16:05:05

report_memory_flag = training_log(loss_dict, total_loss_dict,

2021-03-07 16:05:05

File "/home/mchorse/gpt-neox/megatron/training.py", line 558, in train

2021-03-07 16:05:05

report_memory_flag = training_log(loss_dict, total_loss_dict,

2021-03-07 16:05:05

File "/home/mchorse/gpt-neox/megatron/training.py", line 500, in training_log

2021-03-07 16:05:05

flops_per_s_per_gpu = get_flops(model, elapsed_time)

2021-03-07 16:05:05

File "/home/mchorse/gpt-neox/megatron/training.py", line 500, in training_log

2021-03-07 16:05:05

flops_per_s_per_gpu = get_flops(model, elapsed_time)

2021-03-07 16:05:05

File "/home/mchorse/gpt-neox/megatron/training.py", line 794, in get_flops

2021-03-07 16:05:05

flops_per_gpu_per_iter = flops_per_iter / world_size

2021-03-07 16:05:05

File "/home/mchorse/gpt-neox/megatron/training.py", line 794, in get_flops

2021-03-07 16:05:05

flops_per_gpu_per_iter = flops_per_iter / world_size

2021-03-07 16:05:05

TypeError: unsupported operand type(s) for /: 'int' and 'str'

2021-03-07 16:05:05

TypeError: unsupported operand type(s) for /: 'int' and 'str'