mi300x-numeric-comparison Table – Weights & Biases

Skip to main content

Randomfoo's workspace

Runs

6

apply_residual_connection_post_layernorm

Finished

-

randomfoo

2w ago

1h 24m 29s

-

meta-llama/Llama-3.2-1B-Instruct

true

false

false

true

-

false

0.9

0.999

-

-

1.0000e-8

-

-

false

-

-

-

-

-

-

-

-

-

-

-

-

["LlamaForCausalLM"]

-

-

false

0

-

-

-

-

false

-

false

-

false

pharaouk/dharma-1/dharma_1_mini.json

2048

eval

Finished

-

randomfoo

2w ago

27m 33s

-

-

-

-

-

-

-

-

-

-

[0.9,0.95]

-

-

false

-

-

-

-

-

-

-

-

-

true

-

-

-

-

-

-

-

-

-

-

-

flash_attention_2

-

-

0

-

-

-

-

-

-

Finished

-

randomfoo

2w ago

2h 14m 17s

-

-

-

-

-

-

-

-

-

-

[0.9,0.95]

-

-

false

-

-

-

-

-

-

-

-

-

true

-

-

-

-

-

-

-

-

-

-

-

flash_attention_2

-

-

0

-

-

-

-

-

-

Finished

-

randomfoo

2w ago

2h 1m

-

-

-

-

-

-

-

-

-

-

[0.9,0.95]

-

-

false

-

-

-

-

-

-

-

-

-

true

-

-

-

-

-

-

-

-

-

-

-

flash_attention_2

-

-

0

-

-

-

-

-

-

Finished

-

randomfoo

2w ago

9h 50m 10s

-

-

-

-

-

-

true

-

0.9

0.999

-

1.0000e-8

-

-

false

-

true

false

false

1000

true

false

0.0.0

-

false

false

false

true

-

false

auto

-

0.1

0

false

-

false

-

-

-

true

-

-

-

-

Finished

-

randomfoo

2w ago

8h 34m 31s

-

-

-

-

-

-

-

-

-

-

[0.9,0.95]

-

-

false

-

-

-

-

-

-

-

-

-

true

-

-

-

-

-

-

-

-

-

-

-

flash_attention_2

-

-

0

-

-

-

-

-

-

1-6

of 6