nanoGPT_testing_gp1 Workspace – Weights & Biases

Skip to main content

cjackson692-university-of-north-texas

nanoGPT_testing_gp1

Cjackson692's workspace

Runs

128

Name

20 visualized

run_block_size128_n_layer4_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size128_n_layer4_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size128_n_layer6_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size128_n_layer6_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size128_n_layer6_n_head8_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size128_n_layer6_n_head8_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size64_n_layer6_n_head8_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size64_n_layer6_n_head8_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size128_n_layer4_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.2

run_block_size128_n_layer4_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.2

run_block_size64_n_layer4_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size64_n_layer4_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size64_n_layer4_n_head8_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size64_n_layer4_n_head8_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size128_n_layer6_n_head4_n_embd256_batch_size16_max_iters1000_dropout0.1

run_block_size128_n_layer6_n_head4_n_embd256_batch_size16_max_iters1000_dropout0.1

run_block_size64_n_layer6_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size64_n_layer6_n_head4_n_embd256_batch_size16_max_iters2000_dropout0.1

run_block_size128_n_layer4_n_head4_n_embd256_batch_size16_max_iters1000_dropout0.1

run_block_size128_n_layer4_n_head4_n_embd256_batch_size16_max_iters1000_dropout0.1

run_block_size64_n_layer6_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size64_n_layer6_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size128_n_layer4_n_head8_n_embd128_batch_size8_max_iters1000_dropout0.1

run_block_size128_n_layer4_n_head8_n_embd128_batch_size8_max_iters1000_dropout0.1

run_block_size128_n_layer6_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size128_n_layer6_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size64_n_layer4_n_head8_n_embd128_batch_size8_max_iters1000_dropout0.1

run_block_size64_n_layer4_n_head8_n_embd128_batch_size8_max_iters1000_dropout0.1

run_block_size64_n_layer4_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.1

run_block_size64_n_layer4_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.1

run_block_size128_n_layer4_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.1

run_block_size128_n_layer4_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.1

run_block_size128_n_layer4_n_head8_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size128_n_layer4_n_head8_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size128_n_layer4_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size128_n_layer4_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size64_n_layer4_n_head8_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size64_n_layer4_n_head8_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size64_n_layer4_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.2

run_block_size64_n_layer4_n_head4_n_embd128_batch_size8_max_iters1000_dropout0.2

1-20

of 20

Evaluation

1

Charts

4

train/loss, val/loss

train/loss, val/loss

mfu

mfu

Showing first 10 runs

lr

lr

Showing first 10 runs

iter

iter

Showing first 10 runs

To pick up a draggable item, press the space bar. While dragging, use the arrow keys to move the item. Press space again to drop the item in its new position, or press escape to cancel.