Shehper's workspace
Runs
38
Name
7 visualized
max_iters
n_layer
n_embd
n_head
out_dir
N
val/loss
train/loss
250000
8
64
2
out-N-3.93e+05
393216
4.53775
4.52522
250000
4
64
2
out-D-9.04e+09-N-1.97e+05
196608
4.71475
4.70398
250000
10
192
3
out-D-9.04e+09-N-4.42e+06
4423680
3.73926
3.74172
250000
8
256
4
out-N-6.29e+06
6291456
3.6224
3.59586
250000
8
128
2
out-N-1.57e+06
1572864
4.0669
4.06087
250000
4
128
2
out-D-9.04e+09-N-7.86e+05
786432
4.23614
4.23197
250000
8
32
2
out-N-9.83e+04
98304
5.19576
5.19791
ID
Group
Job Type
Updated
End Time
Hostname
Description
Commit
GitHub
GPU Count
GPU Type
State
Notes
User
Tags
Created
Runtime
Sweep
D
always_save_checkpoint
backend
batch_size
beta1
beta2
bias
block_size
compile
dataset
decay_lr
device
dropout
dtype
eval_interval
eval_iters
eval_only
fraction_of_data
grad_clip
gradient_accumulation_steps
init_from
learning_rate
log_interval
lr_decay_iters
min_lr
scale_D
scale_N
wandb_log
wandb_project
wandb_run_name
klm0tiam
-
-
Dec 03 '23 19:46
Oct 30 '23 05:04
-
-
-
-
4
NVIDIA A100-PCIE-40GB
Finished
shehper
6d 7h 55m 46s
-
9035582198
false
nccl
16
0.9
0.95
false
1024
true
openwebtext
true
cuda
0.1
bfloat16
1000
200
false
1
1
32
scratch
0.0014419
10
250000
0
false
true
true
owt-scaling
N=3.93e+05
awa03mes
-
-
Dec 03 '23 20:30
Oct 29 '23 17:47
-
-
-
-
4
NVIDIA A100-PCIE-40GB
Finished
shehper
5d 21h 4m 42s
-
9035582198
false
nccl
16
0.9
0.95
false
1024
true
openwebtext
true
cuda
0.1
bfloat16
1000
200
false
1
1
32
scratch
0.0015386
10
250000
0
true
true
true
owt-scaling
N=1.97e+05
3aq52qz9
-
-
Dec 03 '23 20:30
Nov 04 '23 21:22
-
-
-
-
4
NVIDIA A100-PCIE-40GB
Finished
shehper
13d 20h 30m 42s
-
9035582198
false
nccl
16
0.9
0.95
false
1024
true
openwebtext
true
cuda
0.1
bfloat16
1000
200
false
1
1
32
scratch
0.0011043
10
250000
0
true
true
true
owt-scaling
N=4.42e+06
puvf20l5
-
-
Dec 03 '23 19:46
Oct 30 '23 13:35
-
-
-
-
4
NVIDIA A100-PCIE-40GB
Finished
shehper
8d 12h 44m 47s
-
9035582198
false
nccl
16
0.9
0.95
false
1024
true
openwebtext
true
cuda
0.1
bfloat16
1000
200
false
1
1
32
scratch
0.0010552
10
250000
0
false
true
true
owt-scaling
N=6.29e+06
86fnizqx
-
-
Dec 03 '23 19:46
Oct 29 '23 10:37
-
-
-
-
4
NVIDIA A100-PCIE-40GB
Finished
shehper
7d 9h 47m 22s
-
9035582198
false
nccl
16
0.9
0.95
false
1024
true
openwebtext
true
cuda
0.1
bfloat16
1000
200
false
1
1
32
scratch
0.0012486
10
250000
0
false
true
true
owt-scaling
N=1.57e+06
yxo8pnrq
-
-
Dec 03 '23 20:30
Oct 29 '23 06:51
-
-
-
-
4
NVIDIA A100-PCIE-40GB
Finished
shehper
7d 6h 1m 39s
-
9035582198
false
nccl
16
0.9
0.95
false
1024
true
openwebtext
true
cuda
0.1
bfloat16
1000
200
false
1
1
32
scratch
0.0013453
10
250000
0
true
true
true
owt-scaling
N=7.86e+05
hs91z1b0
-
-
Dec 03 '23 19:46
Oct 30 '23 00:12
-
-
-
-
4
NVIDIA A100-PCIE-40GB
Finished
shehper
7d 23h 23m
-
9035582198
false
nccl
16
0.9
0.95
false
1024
true
openwebtext
true
cuda
0.1
bfloat16
1000
200
false
1
1
32
scratch
0.0016353
10
250000
0
false
true
true
owt-scaling
N=9.83e+04
1-7
of 7