Skip to main content
eleutherai
Projects
pythia
Run groups
v2-70M-deduped_2b0i4yk5
Logs
Group
Workspace
Runs
Logs
Files
Artifacts

Atmallen8's group workspace

Timestamps visible
2023-02-22 19:19:56
NCCL version 2.14.3+cuda11.7
2023-02-22 19:19:56
Using ./extensions/ as PyTorch extensions root...
2023-02-22 19:19:56
Loading extension module utils...
2023-02-22 19:20:00
[2023-02-22 19:19:59,532] [INFO] [engine.py:1551:_load_checkpoint] rank: 8 loading checkpoint: /fsx/dashiell/pythia/70m-deduped/global_step143000/mp_rank_00_model_states.pt
2023-02-22 19:20:00
Found tasks: ['lambada_openai']
2023-02-22 19:20:00
No config specified, defaulting to: lambada_openai/default
2023-02-22 19:20:00
Found cached dataset lambada_openai (/admin/home-dashiell/.cache/huggingface/datasets/EleutherAI___lambada_openai/default/1.0.0/57baddecfa09d1790541ef07274c5666abfbe9d2ccd0cd46013cd557b0343095)
2023-02-22 19:20:00
100%|████████████████████████████████████████████| 1/1 [00:00<00:00, 101.26it/s]
2023-02-22 19:20:00
No config specified, defaulting to: lambada_openai/default
2023-02-22 19:20:00
Found cached dataset lambada_openai (/admin/home-dashiell/.cache/huggingface/datasets/EleutherAI___lambada_openai/default/1.0.0/57baddecfa09d1790541ef07274c5666abfbe9d2ccd0cd46013cd557b0343095)
2023-02-22 19:20:00
100%|████████████████████████████████████████████| 1/1 [00:00<00:00, 604.63it/s]
2023-02-22 19:20:00
No config specified, defaulting to: lambada_openai/default
2023-02-22 19:20:00
Found cached dataset lambada_openai (/admin/home-dashiell/.cache/huggingface/datasets/EleutherAI___lambada_openai/default/1.0.0/57baddecfa09d1790541ef07274c5666abfbe9d2ccd0cd46013cd557b0343095)
2023-02-22 19:20:00
100%|████████████████████████████████████████████| 1/1 [00:00<00:00, 823.22it/s]
2023-02-22 19:20:02
Running loglikelihood requests
2023-02-22 19:21:32
bootstrapping for stddev: perplexity
2023-02-22 19:21:37
100%|████████████████████████████████████████| 10/10 [00:00<00:00, 24614.46it/s]