snli-distilbert-base-uncased-simple-2e-05 | vat Workspace – Weights & Biases

Skip to main content

Arampacha's group workspace

Group: snli-distilbert-base-uncased-simple-2e-05

eval/accuracy

-

-

-

1-3

of 3

Tags

Notes

Simple finetuning distilbert-base-uncased with RAdam lr=2e-05

Tags

distilbert-base-uncased

radam

simple

snli

Author

State

Finished

Start time

April 20th, 2021 2:28:08 PM

Runtime

49m

Tracked hours

48m 17s

Run path

fastai_community/vat/p0r98ml8

OS

Linux-5.4.0-66-generic-x86_64-with-glibc2.10

Python version

3.8.5

Git repository

git clone https://github.com/aikindergarten/vat

Git state

git checkout -b "snli-distilbert-base-uncased-simple" 0fcb29ba2615a8ed9454453029fc0575f83cf719

Command

vat/nbs/_lm_finetuning_fastai_blurr_nli.ipynb

System Hardware

CPU count	64
GPU count	1
GPU type	Quadro RTX 5000

W&B CLI Version

0.10.27

Group

snli-distilbert-base-uncased-simple-2e-05

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 19 keys
- batch per epoch:
  8,583
- batch size:
  64
- dataset.tfms:
  "[Pipeline: get_x, Pipeline: ItemGetter -> Categorize -- {'vocab': [0, 1, 2], 'sort': True, 'add_na': False}]"
- device:
  "cuda"
- dls.after_batch:
  "Pipeline: HF_AfterBatchTransform"
- dls.after_item:
  "Pipeline: ToTensor"
- dls.before_batch:
  "Pipeline: HF_BeforeBatchTransform"
- frozen:
  false
- frozen idx:
  0
- HF_BaseModelCallback:
  true
- ▶
  Learner:{} 12 keys
- MixedPrecision:
  true
- model parameters:
  66,955,779
- n_inp:
  1
- ParamScheduler:
  true
- ProgressCallback:
  true
- ▶
  Recorder:{} 3 keys
  - add_time:
    true
  - train_metrics:
    false
  - valid_metrics:
    true
- TrainEvalCallback:
  true
- ▶
  WandbCallback:{} 9 keys

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 30 keys
- accuracy:
  0.8995122909545898
- beta_0:
  0
- beta_1:
  0
- beta_2:
  0
- beta_3:
  0
- epoch:
  5
- eps_0:
  0.00001
- eps_1:
  0.00001
- eps_2:
  0.00001
- eps_3:
  0.00001
- ▶
  graph_0:{} 4 keys
  - _type:
    "graph-file"
  - path:
    "media/graph/graph_0_summary_8697e298.graph.json"
  - sha256:
    "8697e2986d8e826b600960214d70bf4d26df28fa73410c9e5e1467546603977b"
  - size:
    13,326
- lr_0:
  0.0000000002000475884
- lr_1:
  0.0000000002000475884
- lr_2:
  0.0000000002000475884
- lr_3:
  0.0000000002000475884
- mom_0:
  0.9499999997620556
- mom_1:
  0.9499999997620556
- mom_2:
  0.9499999997620556
- mom_3:
  0.9499999997620556
- raw_loss:
  0.289999783039093
- sqr_mom_0:
  0.99
- sqr_mom_1:
  0.99
- sqr_mom_2:
  0.99
- sqr_mom_3:
  0.99
- train_loss:
  0.18586686253547668
- valid_loss:
  0.310299277305603
- wd_0:
  0
- wd_1:
  0
- wd_2:
  0
- wd_3:
  0

This run produced these artifacts as outputs. Total: 1. Learn more

run-p0r98ml8-history:v0

Loading...