mean-teacher-consistency1 | gpt Workspace – Weights & Biases

Skip to main content

The scheduled database maintenance planned for Friday, Nov 14th at 6:00 PM PST has been postponed and rescheduled for Saturday, Nov 15th at 6:00 PM PST. Thank you for your patience and visit https://status.wandb.com for updates.

Clashluke's group workspace

Group: mean-teacher-consistency1

1-1

of 1

Tags

Notes

Author

State

Crashed

Start time

October 30th, 2022 7:17:15 AM

Runtime

6h 46m 59s

Tracked hours

4h 36m 30s

Run path

homebrewnlp/gpt/38gtriv1izjdgd6dzht6yli8pc3t2j9b

OS

Linux-5.4.0-1043-gcp-x86_64-with-glibc2.29

Python version

3.8.5

Git repository

git clone https://github.com/HomebrewNLP/HomebrewNLP-Jax

Git state

git checkout -b "mean-teacher-consistency1-0" 2cec6491432bf407b1ce0df397b5f80c15a19242

Command

main.py

System Hardware

CPU count

48

W&B CLI Version

0.13.4

Group

mean-teacher-consistency1

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 13 keys
- add_depth:
  false
- ▶
  data:{} 8 keys
- depth:
  0
- ▶
  dims:{} 12 keys
- fail_on_missing_parameter:
  true
- global_prefix:
  ""
- ▶
  model:{} 10 keys
- name_cache_offsets:{} 0 keys
- ▶
  optimizer:{} 15 keys
- parameter_usages:{} 0 keys
- seed:
  0
- ▶
  training:{} 12 keys
- ▶
  wandb:{} 7 keys

Summary metrics are your model's outputs. Learn more

▶
Summary metrics:{} 25 keys
- Accuracy/Current:
  0.34757065773010254
- Accuracy/Median64:
  0.3373154401779175
- Accuracy/Median256:
  0.33022427558898926
- Accuracy/Median1024:
  0.29617273807525635
- Consistency Loss/Current:
  46.601898193359375
- Consistency Loss/Median64:
  49.30577850341797
- Consistency Loss/Median256:
  62.70148468017578
- Consistency Loss/Median1024:
  89.34706115722656
- EMA Accuracy/Current:
  0.3074650764465332
- EMA Accuracy/Median64:
  0.3014789819717407
- EMA Accuracy/Median256:
  0.2894192934036255
- EMA Accuracy/Median1024:
  0.22099244594573977
- EMA Loss/Current:
  2.8900203704833984
- EMA Loss/Median64:
  2.9004111289978027
- EMA Loss/Median256:
  2.956761360168457
- EMA Loss/Median1024:
  3.24216365814209
- Loss/Current:
  2.5680742263793945
- Loss/Median64:
  2.5979092121124268
- Loss/Median256:
  2.662703275680542
- Loss/Median1024:
  2.8982303142547607
- Optimizer/Learning Rate:
  0.009919625706970692
- Speed/Batches per Second:
  0.07004427892979828
- Speed/Parameters * Tokens per Day:
  5,142,335,122,243,780,608
- Speed/Tokens per Day:
  6,345,799,184.715163
- Speed/Tokens Seen:
  1,213,202,432

This run produced these artifacts as outputs. Total: 1. Learn more

run-38gtriv1izjdgd6dzht6yli8pc3t2j9b-history:v0

Loading...