imdb-roberta-base-hf-3e-05 | vat Workspace – Weights & Biases

Skip to main content

Arampacha's group workspace

Group: imdb-roberta-base-hf-3e-05

eval/accuracy

0.958

0.95376

-

0.95608

0.95568

0.95332

1-6

of 6

Tags

Notes

HF finetuning roberta-base with AdamW lr=3e-05

Tags

adamw

alum

imdb

roberta-base

Author

State

Finished

Start time

April 22nd, 2021 4:31:50 PM

Runtime

2h 6m 43s

Tracked hours

1h 16m 55s

Run path

fastai_community/vat/1ou29fny

OS

Linux-4.15.0-123-generic-x86_64-with-debian-buster-sid

Python version

3.7.6

Command

<python with no main file> -f /workspace/.local/share/jupyter/runtime/kernel-37a4d256-31ea-47e5-a11e-7b3f699345fd.json

System Hardware

CPU count	56
GPU count	1
GPU type	Tesla V100S-PCIE-32GB

W&B CLI Version

0.10.12

Group

imdb-roberta-base-hf-3e-05

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 130 keys
- _n_gpu:
  1
- _name_or_path:
  "roberta-base"
- adafactor:
  false
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_epsilon:
  0.00000001
- add_cross_attention:
  false
- ▶
  architectures:[] 1 item
  - 0:
    "RobertaForMaskedLM"
- attention_probs_dropout_prob:
  0.1
- bad_words_ids:
  null
- bos_token_id:
  0
- chunk_size_feed_forward:
  0
- dataloader_drop_last:
  false
- dataloader_num_workers:
  4
- dataloader_pin_memory:
  true
- ddp_find_unused_parameters:
  "None"
- debug:
  false
- decoder_start_token_id:
  null
- deepspeed:
  "None"
- disable_tqdm:
  false
- diversity_penalty:
  0
- do_eval:
  "None"
- do_predict:
  false
- do_sample:
  false
- do_train:
  false
- early_stopping:
  false
- encoder_no_repeat_ngram_size:
  0
- eos_token_id:
  2
- eval_accumulation_steps:
  "None"
- eval_batch_size:
  64
- eval_steps:
  200
- evaluation_strategy:
  "epoch"
- finetuning_task:
  null
- forced_bos_token_id:
  null
- forced_eos_token_id:
  null
- fp16:
  true
- fp16_backend:
  "auto"
- fp16_full_eval:
  false
- fp16_opt_level:
  "O1"
- gradient_accumulation_steps:
  1
- gradient_checkpointing:
  false
- greater_is_better:
  "None"
- group_by_length:
  true
- hidden_act:
  "gelu"
- hidden_dropout_prob:
  0.1
- hidden_size:
  768
- vocab_size:
  50,265
- warmup_ratio:
  0.2
- warmup_steps:
  0
- weight_decay:
  0

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 11 keys
- eval/accuracy:
  0.958
- eval/loss:
  0.1252136081457138
- eval/runtime:
  249.8749
- eval/samples_per_second:
  100.05
- train/epoch:
  5
- train/global_step:
  7,815
- train/learning_rate:
  0.00000000042609214894
- train/loss:
  0.2149
- train/total_flos:
  25,418,934,405,540,960
- train/train_runtime:
  4,539.5106
- train/train_samples_per_second:
  1.722

This run produced these artifacts as outputs. Total: 1. Learn more

run-1ou29fny-history:v0

Loading...