Nickypro's workspace
Runs
135
Name
14 visualized
State
Notes
User
Tags
Created
Runtime
Sweep
additional_datasets
attn_eps
attn_frac
attn_mode
attn_prune_heads
attn_prune_heads_mode
attn_prune_type
attn_scoring
collection_sample_size
cripple
datasets
delete_residual_biases
do_attn_mean_offset
dtype
eval_sample_size
ff_eps
ff_frac
ff_scoring
focus
model_repo
model_size
recalculate_activations
run_pre_test
svd_attn
svd_combine_biases
token_limit
topk
use_accelerator
n_steps
wandb_project
scoring_normalization
wandb_entity
wandb_run_name
mask_fn
accuracy/civil/base
accuracy/civil/skip
accuracy/civil/topk
accuracy/civil/topk_skip
accuracy/code/base
accuracy/code/skip
accuracy/code/topk
accuracy/code/topk_skip
accuracy/pile/base
accuracy/pile/skip
Killed
nickypro
20h 7m 25s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","toxicity","wiki","civil"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
34.81305
31.16159
65.9421
62.63009
0
0
0
0
0
0
Failed
nickypro
2h 42m 41s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxicity","civil","wiki","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
5h 22m 3s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxic","toxicity","civil"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% t200
step
34.92842
31.27356
66.0802
62.79804
0
0
0
0
0
0
Crashed
nickypro
12h 38m 3s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","wiki","toxicity","civil"]
-
false
fp32
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% p+o
step
34.97212
31.34254
66.09855
62.82604
-
-
-
-
-
-
Failed
nickypro
18s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","toxicity","wiki","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% p+o
step
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
10h 43m 42s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxic","civil","toxicity"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% t200
step
34.71079
31.06661
65.78303
62.46513
0
0
0
0
0
0
Killed
nickypro
33m 34s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","civil","toxicity","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% t200
step
34.98348
31.35353
66.09156
62.81804
-
-
-
-
-
-
Failed
nickypro
28m 14s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","toxicity","wiki","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% t200
step
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
1h 37m 50s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","toxic","wiki","toxicity"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% t200
step
34.98348
31.35353
66.09156
62.81804
-
-
-
-
-
-
Killed
nickypro
52m 44s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","wiki","toxicity","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% t200
step
34.98348
31.35353
66.09156
62.81804
-
-
-
-
-
-
Killed
nickypro
18h 36m 50s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","wiki","civil","toxicity"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% p+o
step
34.59629
30.92765
65.5925
62.26819
0
0
0
0
0
0
Killed
nickypro
2m 43s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxicity","wiki","civil","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% p+o
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
52m 57s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxicity","civil","toxic","wiki"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% p+o
step
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
31m 14s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","toxic","wiki","toxicity"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% p+o
step
34.97649
31.34454
66.09244
62.81804
-
-
-
-
-
-
Failed
nickypro
50m 14s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxicity","civil","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5% p+o
step
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
1h 12m 59s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","wiki","toxicity","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
34.93279
31.27656
66.07408
62.79105
0
0
0
0
0
0
Crashed
nickypro
5h 14m 31s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxic","civil","toxicity"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
34.65135
31.01163
65.68602
62.37516
0
0
0
0
0
0
Crashed
nickypro
5h 56m 16s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","civil","toxicity","wiki"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
34.7641
31.0986
65.88966
62.5841
0
0
0
0
0
0
Failed
nickypro
30m 24s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","wiki","toxicity","civil"]
-
false
fp16
10000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-small 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
35m 56s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxic","civil","toxicity"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
33m 42s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","toxicity","civil","wiki"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
6m 27s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","toxic","wiki","toxicity"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
6m 25s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","civil","wiki","toxicity"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
7s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxicity","civil","toxic","wiki"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
6s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","toxicity","civil","wiki"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
7s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxicity","wiki","civil","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
6s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","toxicity","wiki","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
6s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","toxicity","toxic","wiki"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
7s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","wiki","toxicity","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
orig
seperability
gpt2-large 0% 0.5%
step
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
6h 9m 40s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","wiki","civil","toxicity"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
-
seperability
gpt2-large 0% 0.5%
-
34.16253
23.16336
65.09615
50.6093
0
0
0
0
0
0
Failed
nickypro
22m 50s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxic","toxicity","civil"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
20
civil-toxic
-
seperability
gpt2-large 0% 0.5%
-
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
21m 29s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxicity","toxic","civil"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
20
civil-toxic
-
seperability
gpt2-large 0% 0.5%
-
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
25m 58s
-
["wiki","toxicity"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxicity","civil","toxic","wiki"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
20
civil-toxic
-
seperability
gpt2-large 0% 0.5%
-
-
-
-
-
-
-
-
-
-
-
Crashed
nickypro
11h 47m 22s
-
["wiki"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxic","civil"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
-
seperability
gpt2-large 0% 0.5%
-
23.64764
12.45589
53.48759
35.1394
0
0
0
0
0
0
Failed
nickypro
9s
-
["wiki","mmlu"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["mmlu","civil","toxic","wiki"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
-
seperability
gpt2-large 0% 0.5%
-
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
18m 44s
-
["wiki","mmlu:all"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","toxic","mmlu:all","wiki"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
-
seperability
gpt2-large 0% 0.5%
-
35.15819
24.34797
66.15074
52.09581
-
-
-
-
-
-
Failed
nickypro
6m 46s
-
["wiki","mmlu"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["wiki","civil","toxic","mmlu"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
200
civil-toxic
-
seperability
gpt2-large 0% 0.5%
-
-
-
-
-
-
-
-
-
-
-
Finished
nickypro
12h 30m 43s
-
["wiki"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","wiki","civil"]
-
false
fp16
100000
0.001
0.001
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
27.99069
17.17533
56.93424
40.23872
0
0
0
0
0
0
Failed
nickypro
4h 40m 58s
-
["wiki"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["civil","wiki","toxic"]
-
false
fp16
100000
0.001
0.001
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
34.63151
23.95909
65.68983
51.48301
0
0
0
0
0
0
Finished
nickypro
21h 38m 54s
-
["wiki"]
0.0001
0.002
pre-out
false
mean
-
abs
100000
toxic
["civil","wiki","toxic"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
34.9892
24.02067
66.34809
52.23248
0
0
0
0
0
0
Finished
nickypro
8h 29m 43s
-
["wiki"]
0.0001
0.001
pre-out
false
mean
-
abs
100000
toxic
["toxic","wiki","civil"]
-
false
fp16
100000
0.001
0
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
35.32706
24.4154
66.74564
52.80209
0
0
0
0
0
0
Finished
nickypro
8h 30m 55s
-
["wiki"]
0.0001
0.001
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxic","civil"]
-
false
fp16
100000
0.001
0.001
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
26.26575
15.50046
54.68112
37.14074
0
0
0
0
0
0
Finished
nickypro
4h 39m 55s
-
["wiki"]
0.0001
0.002
pre-out
false
mean
-
abs
100000
toxic
["toxic","civil","wiki"]
-
false
fp16
100000
0.001
0.002
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
31.44505
20.60799
61.77435
46.30851
0
0
0
0
0
0
Killed
nickypro
2h 8m 31s
-
["wiki"]
0.0001
0.005
pre-out
false
mean
-
abs
100000
toxic
["toxic","wiki","civil"]
-
false
fp16
100000
0.001
0.01
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
29.97852
18.8252
60.04505
43.90814
0
0
0
0
0
0
Crashed
nickypro
1d 19h 52m 41s
-
["wiki"]
0.0001
0
value
false
mean
-
abs
100000
toxic
["wiki","civil","toxic"]
-
false
fp16
100000
0.001
0.002
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
10.80847
2.2125
29.66651
9.40361
0
0
0
0
0
0
Crashed
nickypro
11h 35m 2s
-
["wiki"]
0.0001
0
value
false
mean
-
abs
100000
toxic
["wiki","toxic","civil"]
-
false
fp16
100000
0.001
0.004
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
16.15885
5.36635
39.74879
18.12667
0
0
0
0
0
0
Killed
nickypro
8m 3s
-
["wiki"]
0.0001
0
value
false
mean
-
abs
100000
toxic
["civil","toxic","wiki"]
-
false
fp16
100000
0.001
0.005
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
2h 55m 33s
-
["wiki"]
0.0001
0.001
value
false
mean
-
abs
100000
toxic
["civil","wiki","toxic"]
-
false
fp16
100000
0.001
0.005
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
26.02389
15.20466
54.38388
36.769
0
0
0
0
0
0
Failed
nickypro
7m 33s
-
["wiki"]
0.0001
0.001
value
false
mean
-
abs
100000
toxic
["civil","toxic","wiki"]
-
false
fp16
100000
0.001
0.005
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
7m 30s
-
["wiki"]
0.0001
0.001
value
false
mean
-
abs
100000
toxic
["toxic","civil","wiki"]
-
false
fp16
100000
0.001
0.005
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
8h 30m 8s
-
["wiki"]
0.0001
0.005
value
false
mean
-
abs
100000
toxic
["civil","wiki","toxic"]
-
false
fp16
100000
0.001
0.01
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
11.66389
2.08258
32.83772
10.40992
0
0
0
0
0
0
Failed
nickypro
6m 16s
-
["wiki"]
0.0001
0.005
value
false
mean
-
abs
100000
toxic
["toxic","civil","wiki"]
-
false
fp16
100000
0.001
0.01
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
1m 35s
-
["wiki"]
0.0001
0.001
value
false
mean
-
abs
100000
toxic
["wiki","toxic","civil"]
-
false
fp16
100000
0.001
0.005
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
9m 5s
-
["wiki"]
0.0001
0.001
value
false
mean
-
abs
100000
toxic
["civil","toxic","wiki"]
-
false
fp16
100000
0.001
0.005
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
54s
-
["wiki"]
0.0001
0.004
value
false
mean
-
abs
100000
toxic
["civil","toxic","wiki"]
-
false
fp16
100000
0.001
0.02
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
3h 22m 20s
-
["wiki"]
0.0001
0.004
value
false
mean
-
abs
100000
toxic
["wiki","toxic","civil"]
-
false
fp16
100000
0.001
0.02
freq
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
14.37723
4.56789
35.94247
15.02179
0
0
0
0
0
0
Failed
nickypro
27m 19s
-
["wiki"]
0.0001
0.004
value
false
mean
-
abs
100000
toxic
["wiki","civil","toxic"]
-
false
fp16
100000
0.001
0.02
abs
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
35.26253
24.23437
66.82786
52.62574
-
-
-
-
-
-
Failed
nickypro
27m 48s
-
["wiki"]
0.0001
0.004
value
false
mean
-
abs
100000
toxic
["toxic","civil","wiki"]
-
false
fp16
100000
0.001
0.02
freq
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
35.26253
24.23437
66.82786
52.62574
-
-
-
-
-
-
Killed
nickypro
7h 15m 40s
-
["wiki"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["wiki","toxic","civil"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
8.51298
1.15821
26.03189
5.67314
0
0
0
0
0
0
Killed
nickypro
4h 34m 13s
-
["wiki"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["civil","toxic","wiki"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
8.51298
1.15821
26.03189
5.67314
0
0
0
0
0
0
Failed
nickypro
6m 17s
-
["wiki"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["toxic","civil","wiki"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Finished
nickypro
4h 3m 37s
-
["wiki"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["toxic","wiki","civil"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
35.20582
24.14058
66.57641
52.43434
0
0
0
0
0
0
Finished
nickypro
4h 15m 57s
-
["wiki"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["wiki","civil","toxic"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
35.20582
24.14058
66.57641
52.43434
0
0
0
0
0
0
Failed
nickypro
5m 15s
-
["wiki"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["toxic","wiki","civil"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
44m 47s
-
["pile"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["toxic","pile","civil"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
35.26068
24.23037
66.83155
52.63074
-
-
-
-
49.09435
39.43299
Failed
nickypro
35m 40s
-
["pile"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["pile","civil","toxic"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
9m 8s
-
["pile"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["pile","civil","toxic"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Killed
nickypro
18m 4s
-
["pile"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["civil","toxic","pile"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
5m 11s
-
["pile"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["toxic","pile","civil"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
47s
-
["p","i","l","e"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["e","l","toxic","civil","i","p"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Failed
nickypro
4m 2s
-
["p","i","l","e"]
0.0001
0
pre-out
false
mean
-
abs
100000
toxic
["toxic","l","e","p","civil","i"]
-
false
fp16
100000
0.001
0.02
std
civil
gpt2-large
gpt2-large
true
true
false
false
1000
10
true
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
1-71
of 71