mesh-transformer-jax Workspace – Weights & Biases

Skip to main content

Morgan's workspace

Runs

27

train/loss

val/loss_prosecraft_val_ft

tokens_processed

6d 20h 4m 9s

Finished

morgan

0.00002

2.15559

2.22871

43120

1

0.9

2830827520

5d 23h 30m 12s

Crashed

morgan

0.00001

2.17868

2.22513

43120

1

0.9

2478768128

22m 1s

Finished

morgan

0.00001

-

-

42895

0.9

0.9

-

21m 41s

Finished

morgan

0.00001

-

-

42895

1

0.9

-

23m 14s

Finished

morgan

0.00001

-

-

42895

-

-

-

21m 24s

Finished

morgan

0.00001

-

-

42895

-

-

-

21m 52s

Failed

morgan

0.00001

-

-

42895

-

-

-

23m 43s

Crashed

morgan

0.00001

-

-

42895

-

-

-

24m 4s

Crashed

morgan

0.00001

-

-

42895

-

-

-

22m 4s

Finished

morgan

0.00001

-

-

42895

-

-

-

19d 16h 37m 32s

Finished

morgan

0.00001

2.21221

2.29307

20000

-

-

1339949056

5d 12h

Crashed

morgan

0.00001

2.21777

2.38704

42895

-

-

-

23d 3h 7m 9s

Finished

morgan

0.00001

1.92378

-

814

-

-

-

18h 28m 13s

Finished

morgan

0.00001

0.10695

-

7700

-

-

-

1h 27m 6s

Killed

morgan

0.00001

2.65913

-

7700

-

-

-

18h 32m 3s

Finished

morgan

0.00001

0.089045

-

7410

-

-

-

2d 19h 13m 3s

Finished

morgan

0.00001

2.10686

-

18450

-

-

-

16h 13s

Finished

morgan

0.00001

0.63784

-

3510

-

-

-

2h 40m 32s

Finished

morgan

0.00005

2.87884

-

290

-

-

-

4d 3h 7m 13s

Crashed

morgan

0.000025

2.21015

-

35438

-

-

-

1-20

of 23

val

3

prosecraft_linear

prosecraft_ft_resumed2

prosecraft_ft_resumed

samples_ft_16bs_1e_1e-5

samples_wd_16bs_10e_1e-5

samples_wd_16bs_10e_1e-5

samples_16bs_10e_1e-5

resumed_28k_prosecraft_GPT3

samples_10e_3900s_1e-5

prosecraft_GPT3_6B_pile_rotary

prosecraft_GPT3_6B_pile_rotary

prosecraft_testing_GPT3_6B_pile_rotary

prosecraft_testing_GPT3_6B_pile_rotary

Tables

1

noise

5

System

9