pythia-70m-deduped | levmckinney Overview – Weights & Biases

Skip to main content

Levmckinney's group workspace

Group: pythia-70m-deduped

1-7

of 7

Tags

Notes

Author

State

Finished

Start time

May 5th, 2023 10:37:24 PM

Runtime

20s

Tracked hours

-

Run path

levmckinney/tuned-lens/lo8k1tkc

W&B CLI Version

0.15.0

Group

pythia-70m-deduped

Config parameters are your model's inputs. Learn more

▶
Config parameters:{} 17 keys
- constant:
  false
- ▶
  data:{} 5 keys
- ▶
  dist:{} 2 keys
  - cpu_offload:
    false
  - fsdp:
    false
- lens_name_or_path:
  null
- loss:
  "LossChoice.CE"
- ▶
  model:{} 5 keys
- num_steps:
  250
- ▶
  opt:{} 6 keys
- output:
  null
- per_gpu_batch_size:
  1
- pre_ln:
  false
- seed:
  42
- separate_unembeddings:
  false
- token_shift:
  null
- tokens_per_step:
  262,144
- wandb:
  "smoke-test-1"
- wandb_upload_checkpoints:
  false

Summary metrics are your model's outputs. Learn more

No summary metrics saved for this run.

Check the summary metrics documentation for more information.