homebrewnlp

Clashluke's group workspace

Group: manual-rebias

236

1-1

of 1

Timestamps visible

2022-11-02 17:30:06

--------------------

2022-11-02 17:30:06

The above exception was the direct cause of the following exception:

2022-11-02 17:30:06

Traceback (most recent call last):

2022-11-02 17:30:06

File "main.py", line 4, in <module>

2022-11-02 17:30:06

main()

2022-11-02 17:30:06

File "/home/ubuntu/HomebrewNLP-Jax/src/main.py", line 188, in main

2022-11-02 17:30:06

data = init_data_and_model(wctx)

2022-11-02 17:30:06

File "/home/ubuntu/HomebrewNLP-Jax/src/main.py", line 142, in init_data_and_model

2022-11-02 17:30:06

timeit("Acquiring optimizer parameters", get_optimizer_state, wctx.ctx)

2022-11-02 17:30:06

File "/home/ubuntu/HomebrewNLP-Jax/src/main.py", line 101, in timeit

2022-11-02 17:30:06

out = fn(*args, **kwargs)

2022-11-02 17:30:06

File "/home/ubuntu/HomebrewNLP-Jax/src/main.py", line 95, in get_optimizer_state

2022-11-02 17:30:06

ctx.parameters = pmapped(ctx.parameters)

2022-11-02 17:30:06

File "/home/ubuntu/HomebrewNLP-Jax/src/main.py", line 90, in _fn

2022-11-02 17:30:06

update(new_ctx, grads, jnp.ones((), dtype=new_ctx.model.computation_dtype))

2022-11-02 17:30:06

File "/home/ubuntu/HomebrewNLP-Jax/src/optimizer.py", line 132, in update

2022-11-02 17:30:06

lr = -get_current_lr(ctx, step)

2022-11-02 17:30:06

File "/home/ubuntu/HomebrewNLP-Jax/src/optimizer.py", line 126, in get_current_lr

2022-11-02 17:30:06

learning_rate *= (1 - opt.exponential_decay) ** jax.nn.relu(step.astype(jnp.float32))

2022-11-02 17:30:06

TypeError: unsupported operand type(s) for -: 'int' and 'str'