imdb-roberta-base-hf-3e-05 | vat Overview – Weights & Biases

Skip to main content

W&B will undergo scheduled maintenance on Saturday, Nov 29 from 6–9 PM PT. The Models, Inference, and Serverless APIs may be briefly unavailable during this time. Check our status page for updates: https://status.wandb.com

Arampacha's group workspace

Group: imdb-roberta-base-hf-3e-05

eval/accuracy

0.958

0.95376

-

0.95608

0.95568

0.95332

1-6

of 6

Tags

Notes

HF finetuning roberta-base with AdamW lr=3e-05

Tags

adamw

alum

imdb

roberta-base

Author

State

Finished

Start time

April 22nd, 2021 4:31:50 PM

Runtime

2h 6m 43s

Tracked hours

1h 16m 55s

Run path

fastai_community/vat/1ou29fny

OS

Linux-4.15.0-123-generic-x86_64-with-debian-buster-sid

Python version

3.7.6

Command

<python with no main file> -f /workspace/.local/share/jupyter/runtime/kernel-37a4d256-31ea-47e5-a11e-7b3f699345fd.json

System Hardware

CPU count	56
GPU count	1
GPU type	Tesla V100S-PCIE-32GB

W&B CLI Version

0.10.12

Group

imdb-roberta-base-hf-3e-05

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 130 keys
- _n_gpu:
  1
- _name_or_path:
  "roberta-base"
- adafactor:
  false
- adam_beta1:
  0.9
- adam_beta2:
  0.999
- adam_epsilon:
  0.00000001
- add_cross_attention:
  false
- ▶
  architectures:[] 1 item
  - 0:
    "RobertaForMaskedLM"
- attention_probs_dropout_prob:
  0.1
- bad_words_ids:
  null
- bos_token_id:
  0
- chunk_size_feed_forward:
  0
- dataloader_drop_last:
  false
- dataloader_num_workers:
  4
- dataloader_pin_memory:
  true
- ddp_find_unused_parameters:
  "None"
- debug:
  false
- decoder_start_token_id:
  null
- deepspeed:
  "None"
- disable_tqdm:
  false
- diversity_penalty:
  0
- do_eval:
  "None"
- do_predict:
  false
- do_sample:
  false
- do_train:
  false
- early_stopping:
  false
- encoder_no_repeat_ngram_size:
  0
- eos_token_id:
  2
- eval_accumulation_steps:
  "None"
- eval_batch_size:
  64
- eval_steps:
  200
- evaluation_strategy:
  "epoch"
- finetuning_task:
  null
- forced_bos_token_id:
  null
- forced_eos_token_id:
  null
- fp16:
  true
- fp16_backend:
  "auto"
- fp16_full_eval:
  false
- fp16_opt_level:
  "O1"
- gradient_accumulation_steps:
  1
- gradient_checkpointing:
  false
- greater_is_better:
  "None"
- group_by_length:
  true
- hidden_act:
  "gelu"
- hidden_dropout_prob:
  0.1
- hidden_size:
  768
- vocab_size:
  50,265
- warmup_ratio:
  0.2
- warmup_steps:
  0
- weight_decay:
  0

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 11 keys
- eval/accuracy:
  0.958
- eval/loss:
  0.1252136081457138
- eval/runtime:
  249.8749
- eval/samples_per_second:
  100.05
- train/epoch:
  5
- train/global_step:
  7,815
- train/learning_rate:
  0.00000000042609214894
- train/loss:
  0.2149
- train/total_flos:
  25,418,934,405,540,960
- train/train_runtime:
  4,539.5106
- train/train_samples_per_second:
  1.722

This run produced these artifacts as outputs. Total: 1. Learn more

run-1ou29fny-history:v0

Loading...