demo_iitp_pr | wandb Workspace – Weights & Biases

Skip to main content

Dk-crazydiv's group workspace

Group: demo_iitp_pr

1-5

of 5

Tags

Notes

Author

State

Finished

Start time

July 16th, 2021 1:42:25 PM

Runtime

13m 27s

Tracked hours

13m 11s

Run path

wandb/hf-flax-roberta-hindi/3i3ua35a

OS

Linux-5.4.104+-x86_64-with-Ubuntu-18.04-bionic

Python version

3.7.10

Command

Copy of IIITP_PR_Downstream_Indic_Glue.ipynb

System Hardware

CPU count	2
GPU count	1
GPU type	Tesla K80

W&B CLI Version

0.11.0

Group

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 139 keys
- _n_gpu:
  1
- _name_or_path:
  "surajp/RoBERTa-hindi-guj-san"
- adafactor:
  false
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_epsilon:
  0.00000001
- add_cross_attention:
  false
- ▶
  architectures:[] 1 item
  - 0:
    "RobertaForMaskedLM"
- attention_probs_dropout_prob:
  0.1
- bad_words_ids:
  null
- bos_token_id:
  0
- chunk_size_feed_forward:
  0
- dataloader_drop_last:
  false
- dataloader_num_workers:
  0
- dataloader_pin_memory:
  true
- ddp_find_unused_parameters:
  "None"
- debug:
  "[]"
- decoder_start_token_id:
  null
- deepspeed:
  "None"
- disable_tqdm:
  false
- diversity_penalty:
  0
- do_eval:
  true
- do_predict:
  false
- do_sample:
  false
- do_train:
  false
- early_stopping:
  false
- encoder_no_repeat_ngram_size:
  0
- eos_token_id:
  2
- eval_accumulation_steps:
  "None"
- eval_batch_size:
  8
- eval_steps:
  500
- evaluation_strategy:
  "epoch"
- finetuning_task:
  null
- forced_bos_token_id:
  null
- forced_eos_token_id:
  null
- fp16:
  false
- fp16_backend:
  "auto"
- fp16_full_eval:
  false
- fp16_opt_level:
  "O1"
- gradient_accumulation_steps:
  1
- gradient_checkpointing:
  false
- greater_is_better:
  "None"
- group_by_length:
  false
- hidden_act:
  "gelu"
- hidden_dropout_prob:
  0.1
- hidden_size:
  768
- vocab_size:
  30,522
- warmup_ratio:
  0
- warmup_steps:
  0
- weight_decay:
  0

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 17 keys
- eval/accuracy:
  0.6615678776290631
- eval/f1:
  0.6600787041311235
- eval/loss:
  0.783840537071228
- eval/precision:
  0.6591947461928341
- eval/recall:
  0.6615678776290631
- eval/runtime:
  4.1671
- eval/samples_per_second:
  125.507
- eval/steps_per_second:
  15.838
- train/epoch:
  5
- train/global_step:
  5,230
- train/learning_rate:
  0
- train/loss:
  0.608
- train/total_flos:
  1,075,271,819,927,040
- train/train_loss:
  0.7249214128600024
- train/train_runtime:
  752.5809
- train/train_samples_per_second:
  27.784
- train/train_steps_per_second:
  6.949

This run produced these artifacts as outputs. Learn more

source-3i3ua35a:v0

run-3i3ua35a-history:v0

Loading...