Corianas's workspace
Runs
34
Name
2 visualized
State
Notes
User
Tags
Created
Runtime
Sweep
always_save_checkpoint
batch_size
beta1
beta2
compile
decay_lr
device
dim
dropout
dtype
eval_interval
eval_iters
eval_only
grad_clip
gradient_accumulation_steps
init_from
learning_rate
log_interval
max_iters
max_seq_len
multiple_of
n_heads
n_kv_heads
n_layers
out_dir
vocab_size
vocab_source
wandb_log
wandb_project
wandb_run_name
warmup_iters
weight_decay
iter
loss/train
loss/val
lr
mfu
step_time
tokens
Killed
corianas
12d 16h 39m 57s
-
false
4
0.9
0.95
true
true
cuda
1024
0
bfloat16
2000
100
false
1
12
scratch
0.0003
1
200000
2048
32
16
8
24
monster_m
1024
custom
true
llamac
run2024_06_17_14_26_42
1000
0.1
153674
0.54899
0.8144
0.000064523
10.10764
7110.10766
15106768896
Failed
corianas
1m 47s
-
false
8
0.9
0.95
true
true
cuda
1024
0
bfloat16
2000
100
false
1
6
scratch
0.0003
1
200000
2048
32
16
8
24
monster_m
1024
custom
true
llamac
run2024_06_17_14_24_36
1000
0.1
-
-
-
-
-
-
-
Failed
corianas
18s
-
false
16
0.9
0.95
true
true
cuda
1024
0
bfloat16
2000
100
false
1
3
scratch
0.0003
1
200000
2048
32
12
12
16
monster_m
1024
custom
true
llamac
run2024_06_17_00_02_22
1000
0.1
-
-
-
-
-
-
-
Finished
corianas
5d 6h 53m 54s
-
false
16
0.9
0.95
true
true
cuda
768
0
bfloat16
2000
100
false
1
3
scratch
0.0003
1
200000
2048
32
12
12
12
monster
1024
custom
true
llamac
run2024_06_11_14_04_27
1000
0.1
200000
1.07563
0.928
0.00003
9.34496
71443.40014
19660800000
Failed
corianas
13s
-
false
16
0.9
0.95
true
true
cuda
768
0
bfloat16
2000
100
false
1
3
scratch
0.0003
1
200000
2048
32
12
12
12
monster
1024
custom
true
llamac
run2024_06_11_14_03_48
1000
0.1
-
-
-
-
-
-
-
Failed
corianas
15s
-
false
16
0.9
0.95
true
true
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.0003
1
200000
2048
32
12
12
12
monster
1024
custom
true
llamac
run2024_06_11_14_03_24
1000
0.1
-
-
-
-
-
-
-
Killed
corianas
7s
-
false
16
0.9
0.95
true
true
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.0003
1
200000
2048
32
12
12
12
out
32000
llama2
true
llamac
run2024_06_11_12_41_31
1000
0.1
-
-
-
-
-
-
-
Killed
corianas
1h 32m 7s
-
true
16
0.9
0.95
true
false
cuda
768
0
bfloat16
250
100
false
1
3
resume
0.000001
1
1000000
2048
32
12
12
12
char_820k
341
custom
true
llamac
run2024_05_25_05_56_47
1000
0.1
822181
0.33616
0.31493
0.000001
10.27099
2263.37266
80823681024
Killed
corianas
17m
-
true
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.000001
1
1000000
2048
32
12
12
12
char_820k
341
custom
true
llamac
run2024_05_25_05_39_31
1000
0.1
820425
0.32094
-
0.000001
10.27029
2263.59916
80651059200
Killed
corianas
5d 23h 20m 54s
-
true
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.000001
1
1000000
2048
32
12
12
12
char_596k
341
custom
true
llamac
run2024_05_19_05_39_20
1000
0.1
821086
0.54882
1.32038
0.000001
10.27146
2263.48472
80716038144
Killed
corianas
2h 35m 50s
-
true
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.000001
1
1000000
2048
32
12
12
12
char_564k
341
custom
true
llamac
run2024_05_19_03_02_44
1000
0.1
568043
0.84231
0.85716
0.000001
10.29192
2256.13284
55840899072
Killed
corianas
2d 4h 57m 57s
-
false
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.00001
1
1000000
2048
32
12
12
12
char_300k_out
341
custom
true
llamac
run2024_05_13_15_35_45
1000
0.1
597148
0.26215
0.27001
0.00001
10.27284
2258.62455
58702036992
Killed
corianas
1d 15h 32m 22s
-
true
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.00001
1
1000000
2048
32
12
12
12
char_300k_out
341
custom
true
llamac
run2024_05_12_00_00_31
1000
0.1
514030
0.56699
0.68687
0.00001
10.24132
2263.19957
50531205120
Killed
corianas
14h 38m 42s
-
false
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.00001
1
1000000
2048
32
12
12
12
char_300k_out
341
custom
true
llamac
run2024_05_11_08_08_07
1000
0.1
469008
0.62166
0.61613
0.00001
10.27104
2263.40985
46105362432
Killed
corianas
1d 23h 32m 21s
-
false
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.00001
1
1000000
2048
32
12
12
12
char_300k_out
341
custom
true
llamac
run2024_05_09_00_52_58
1000
0.1
484731
0.6697
0.65516
0.00001
10.27025
2263.18455
47650996224
Killed
corianas
9h 40m 17s
-
false
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.00001
1
1000000
2048
32
12
12
12
char_300k_out
341
custom
true
llamac
run2024_05_08_15_09_13
1000
0.1
425167
0.78059
0.63117
0.00001
10.29615
2260.67328
41795616768
Killed
corianas
2m 29s
-
false
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.00001
1
1000000
2048
32
12
12
12
char_300k_out
341
custom
true
llamac
run2024_05_08_15_06_19
1000
0.1
410041
0.95119
-
0.00001
10.27835
2263.41462
40308670464
Failed
corianas
12m 1s
-
false
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.00001
1
1000000
2048
32
12
12
12
char_300k_out
341
custom
true
llamac
run2024_05_08_14_52_10
1000
0.1
410294
0.91062
-
0.00001
10.3026
2256.07777
40333541376
Killed
corianas
57m 31s
-
false
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.00001
1
1000000
2048
32
12
12
12
char_300k_out
341
custom
true
llamac
run2024_05_08_13_39_48
1000
0.1
411499
0.87908
-
0.00001
10.27053
2263.5572
40451997696
Killed
corianas
7s
-
false
16
0.9
0.95
true
false
cuda
768
0
bfloat16
2000
100
false
1
3
resume
0.00001
1
750000
2048
32
12
12
12
char_300k_out
341
custom
true
llamac
run2024_05_08_13_39_24
1000
0.1
-
-
-
-
-
-
-
1-20
of 34