bbca | wandb Overview – Weights & Biases

Skip to main content

Dk-crazydiv's group workspace

Group: bbca

1-12

of 12

Tags

Notes

Author

State

Crashed

Start time

July 12th, 2021 3:25:11 PM

Runtime

1h 26m 15s

Tracked hours

6m 5s

Run path

wandb/hf-flax-roberta-hindi/owy2v1a5

OS

Linux-5.4.104+-x86_64-with-Ubuntu-18.04-bionic

Python version

3.7.10

Command

BBCA downstream indic-glued.ipynb

System Hardware

CPU count	2
GPU count	1
GPU type	Tesla P100-PCIE-16GB

W&B CLI Version

0.10.33

Group

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 140 keys
- _n_gpu:
  1
- _name_or_path:
  "flax-community/roberta-pretraining-hindi"
- adafactor:
  false
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_epsilon:
  0.00000001
- add_cross_attention:
  false
- ▶
  architectures:[] 1 item
  - 0:
    "RobertaForMaskedLM"
- attention_probs_dropout_prob:
  0.1
- bad_words_ids:
  null
- bos_token_id:
  0
- chunk_size_feed_forward:
  0
- dataloader_drop_last:
  false
- dataloader_num_workers:
  0
- dataloader_pin_memory:
  true
- ddp_find_unused_parameters:
  "None"
- debug:
  "[]"
- decoder_start_token_id:
  null
- deepspeed:
  "None"
- disable_tqdm:
  false
- diversity_penalty:
  0
- do_eval:
  true
- do_predict:
  false
- do_sample:
  false
- do_train:
  false
- early_stopping:
  false
- encoder_no_repeat_ngram_size:
  0
- eos_token_id:
  2
- eval_accumulation_steps:
  "None"
- eval_batch_size:
  8
- eval_steps:
  500
- evaluation_strategy:
  "epoch"
- finetuning_task:
  null
- forced_bos_token_id:
  null
- forced_eos_token_id:
  null
- fp16:
  false
- fp16_backend:
  "auto"
- fp16_full_eval:
  false
- fp16_opt_level:
  "O1"
- gradient_accumulation_steps:
  1
- gradient_checkpointing:
  false
- greater_is_better:
  "None"
- group_by_length:
  false
- hidden_act:
  "gelu"
- hidden_dropout_prob:
  0.1
- hidden_size:
  768
- vocab_size:
  50,265
- warmup_ratio:
  0
- warmup_steps:
  0
- weight_decay:
  0

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 15 keys
- eval/accuracy:
  0.7113163972286374
- eval/loss:
  1.4850834608078003
- eval/runtime:
  4.0404
- eval/samples_per_second:
  214.337
- eval/steps_per_second:
  26.978
- ▶
  graph_0:{} 4 keys
  - _type:
    "graph-file"
  - path:
    "media/graph/graph_0_summary_2c2660078f548cff6d21.graph.json"
  - sha256:
    "2c2660078f548cff6d2103e6612a309278d610e3011486d600e24ecb1fef9dce"
  - size:
    26,108
- train/epoch:
  5
- train/global_step:
  2,170
- train/learning_rate:
  0.00000391705069124424
- train/loss:
  0.1997
- train/total_flos:
  1,659,585,530,365,440
- train/train_loss:
  0.5592170223113029
- train/train_runtime:
  323.9097
- train/train_samples_per_second:
  53.518
- train/train_steps_per_second:
  6.699

This run produced these artifacts as outputs. Learn more

run-owy2v1a5-history:v0

Loading...