Final | devmadhursaini-panjab-university Overview – Weights & Biases

Skip to main content

Devmadhursaini's group workspace

Group: Final

1-1

of 1

Tags

Notes

Author

State

Crashed

Start time

October 27th, 2024 4:13:07 PM

Runtime

22h 38m 22s

Tracked hours

22h 18m 37s

Run path

devmadhursaini-panjab-university/Chess-Llama/uc71ogmh

OS

Linux-5.15.163+-x86_64-with-glibc2.35

Python version

3.10.12

Colab link

https://colab.research.google.com/notebook#fileId=/embedded/projects/sylvan-reserve-435710-b5/locations/us-central1/repositories/14afc4c4-d390-4ad1-85e1-751e950053a3

Command

train.ipynb

System Hardware

CPU count	4
Logical CPU count	8
GPU count	1
GPU type	[NVIDIA L4]

W&B CLI Version

0.18.3

Group

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 210 keys
- _name_or_path:
  ""
- ▶
  accelerator_config:{} 6 keys
- adafactor:
  false
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_epsilon:
  0.00000001
- add_cross_attention:
  false
- architectures:
  null
- attention_bias:
  false
- attention_dropout:
  0
- auto_find_batch_size:
  false
- bad_words_ids:
  null
- batch_eval_metrics:
  false
- begin_suppress_tokens:
  null
- bf16:
  false
- bf16_full_eval:
  false
- bos_token_id:
  1,971
- chars_per_token:
  "<CHARS_PER_TOKEN>"
- chunk_size_feed_forward:
  0
- cross_attention_hidden_size:
  null
- data_seed:
  null
- dataloader_drop_last:
  false
- dataloader_num_workers:
  0
- dataloader_persistent_workers:
  false
- dataloader_pin_memory:
  true
- dataloader_prefetch_factor:
  null
- dataset_batch_size:
  1,000
- dataset_num_proc:
  null
- dataset_text_field:
  "text"
- ddp_backend:
  null
- ddp_broadcast_buffers:
  null
- ddp_bucket_cap_mb:
  null
- ddp_find_unused_parameters:
  null
- ddp_timeout:
  1,800
- debug:[] 0 items
- decoder_start_token_id:
  null
- deepspeed:
  null
- disable_tqdm:
  false
- dispatch_batches:
  null
- diversity_penalty:
  0
- do_eval:
  false
- do_predict:
  false
- do_sample:
  false
- do_train:
  false
- early_stopping:
  false
- encoder_no_repeat_ngram_size:
  0
- vocab_size:
  1,974
- warmup_ratio:
  0
- warmup_steps:
  0
- weight_decay:
  0

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 10 keys
- total_flos:
  377,700,493,852,634,112
- train_loss:
  1.654233332066776
- train_runtime:
  79,948.419
- train_samples_per_second:
  213.56
- train_steps_per_second:
  13.348
- train/epoch:
  5
- train/global_step:
  1,067,115
- train/grad_norm:
  0.6368836760520935
- train/learning_rate:
  0.0000033337550310885
- train/loss:
  1.4769

This run produced these artifacts as outputs. Total: 2. Learn more

run-uc71ogmh-history:v0

run-uc71ogmh-events:v0

Loading...