Skip to main content
eleutherai
Projects
gpt-thicc
Run groups
20B_eval_multi
Logs
Group
Workspace
Runs
Logs
Files
Artifacts

Igoro's group workspace

Timestamps visible
2022-01-14 16:39:57
             'mathqa': {'acc': 0.2693467336683417,
2022-01-14 16:39:57
                        'acc_norm': 0.26867671691792294,
2022-01-14 16:39:57
                        'acc_norm_stderr': 0.008114659613200549,
2022-01-14 16:39:57
                        'acc_stderr': 0.008121048652111622},
2022-01-14 16:39:57
             'piqa': {'acc': 0.719804134929271,
2022-01-14 16:39:57
                      'acc_norm': 0.719804134929271,
2022-01-14 16:39:57
                      'acc_norm_stderr': 0.010478122015577086,
2022-01-14 16:39:57
                      'acc_stderr': 0.010478122015577074},
2022-01-14 16:39:57
             'pubmedqa': {'acc': 0.663, 'acc_stderr': 0.014955087918653595},
2022-01-14 16:39:57
             'winogrande': {'acc': 0.6085240726124704,
2022-01-14 16:39:57
                            'acc_stderr': 0.013717487071290856}})
2022-01-14 16:40:01
100%|##########| 1/1 [00:00<00:00, 89.26it/s]
2022-01-14 16:40:01
bootstrapping for stddev: perplexity
2022-01-14 16:40:03
100%|##########| 1/1 [00:00<00:00, 46.40it/s]
2022-01-14 16:40:03
bootstrapping for stddev: perplexity
2022-01-14 16:40:03
bootstrapping for stddev: perplexity
2022-01-14 16:40:05
100%|##########| 1/1 [00:00<00:00, 10.16it/s]
2022-01-14 16:40:05
100%|##########| 1/1 [00:00<00:00, 11.04it/s]
2022-01-14 16:40:05
bootstrapping for stddev: perplexity
2022-01-14 16:40:15
waiting for 36000 seconds