Abstractor - L=1, d=128, h=8 | dual_attention--math--algebra__sequence_next_term Table – Weights & Biases

Skip to main content

Awni00's group workspace

Group: Abstractor - L=1, d=128, h=8

abstractor_kwargs.activation

abstractor_kwargs.d_model

abstractor_kwargs.dff

abstractor_kwargs.dropout_rate

abstractor_kwargs.max_len

abstractor_kwargs.n_heads

abstractor_kwargs.n_layers

abstractor_kwargs.norm_first

abstractor_kwargs.symbol_add_pos_embedding

abstractor_kwargs.symbol_retriever_kwargs.d_model

abstractor_kwargs.symbol_retriever_kwargs.n_heads

abstractor_kwargs.symbol_retriever_kwargs.n_symbols

abstractor_kwargs.symbol_retriever_type

abstractor_kwargs.use_self_attn

Finished

awni00

1y ago

5h 9m 25s

-

relu

128

256

0.1

161

8

1

false

false

128

4

161

symbolic_attention

true

128

relu

true

256

0.1

8

-

8

-

-

-

-

false

-

-

-

-

-

-

relu

false

256

0.1

8

-

-

-

-

-

false

Finished

awni00

1y ago

3h 9m 10s

-

relu

128

256

0.1

161

8

1

false

false

128

4

161

symbolic_attention

true

128

relu

true

256

0.1

8

-

8

-

-

-

-

false

-

-

-

-

-

-

relu

false

256

0.1

8

-

-

-

-

-

false

Finished

awni00

1y ago

5h 9m 25s

-

relu

128

256

0.1

161

8

1

false

false

128

4

161

symbolic_attention

true

128

relu

true

256

0.1

8

-

8

-

-

-

-

false

-

-

-

-

-

-

relu

false

256

0.1

8

-

-

-

-

-

false

Finished

awni00

1y ago

3h 9m 13s

-

relu

128

256

0.1

161

8

1

false

false

128

4

161

symbolic_attention

true

128

relu

true

256

0.1

8

-

8

-

-

-

-

false

-

-

-

-

-

-

relu

false

256

0.1

8

-

-

-

-

-

false

Finished

awni00

1y ago

5h 9m 24s

-

relu

128

256

0.1

161

8

1

false

false

128

4

161

symbolic_attention

true

128

relu

true

256

0.1

8

-

8

-

-

-

-

false

-

-

-

-

-

-

relu

false

256

0.1

8

-

-

-

-

-

false

1-5

of 5