Skip to main content
ltorroba
Projects
exploring-inverse-kd
Reports
Sweeps for 2-->3 experiments

Sweeps for 2-->3 experiments

Lucas F Torroba Hennigen
Created on December 23|Last edited on December 28
We consider the three methods in the PDF. The setup is the teacher--student setup; same as before.
We consider two ways of generating the linear combination AA (which is a 2x1 matrix in the 2-->3 case):
  1. convex: We sample one weight w Uniform(0,1)w ~ \text{Uniform}(0, 1), and set the other weight as 1−w1 - w
  2. non-convex: We sample the two weights from N(0,12)\mathcal{N}(0, 1^2)
I recommend you go by the table, but I left the graph in there as well, just beware it might not display all the runs. The table has two tabs: one for the linear/identity activation case, and one for the relu activation case. The entries are sorted in descending order of epochs until convergence (aka. settings of AA that, across re-runs, seemed to lead to faster convergence times upon growth)

convexnon_convexrun_modefpfp_trivialno_scalemodelinearreluactivation0.00.51.01.52.02.53.03.54.04.5weights_abs_diff3.03.54.04.55.05.56.06.57.07.58.08.59.0avg_large_final_loss9008007006005004003002001000avg_epochs_until_convergence
2-->3 relu
396
2-->3 linear
372
Name
372 visualized
run_type
fp
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
no_scale
fp_trivial
no_scale
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
fp_trivial
Runtime
Hostname
Notes
GPU Type
GPU Count
Tags
activation
mode
a_weight_1
a_weight_2
b_weight_1
b_weight_2
expansion_seed
expansion_steps
final_additional_steps
neurons_to_add
no_preserve_parent_norm
noise_magnitude
num_expansions
rescale_to_magnitude
run_mode
run_mode
avg_epochs_until_convergence
avg_large_final_loss
avg_small_final_loss
weight_1
weight_2
weights_abs_diff
weights_effective_rank
A
U0_effective_rank_main
U0_effective_rank_phase_1
U0_effective_rank_phase_2
U1_effective_rank_main
U1_effective_rank_phase_1
U1_effective_rank_phase_2
U2_effective_rank_main
U2_effective_rank_phase_2
U3_effective_rank_main
U4_effective_rank_main
U_avg_max_sim_main
U_avg_max_sim_phase_1
U_condition_number_main
U_condition_number_phase_0
U_condition_number_phase_1
U_condition_number_phase_2
U_effective_rank_main
U_effective_rank_phase_0
U_effective_rank_phase_1
U_effective_rank_phase_2
U_mat_norm_main
13m 18s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
30.96
8.85104
9.41059
0.037952
0.1509
0.11294
1.65159
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 20s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
31.32
8.85107
9.41059
0.041476
-0.016918
0.058394
1.8256
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 9s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
32.44
8.85113
9.41059
-0.21344
0.070142
0.28358
1.74962
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 5s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
34.32
8.85109
9.41059
0.1204
-0.091615
0.21202
1.98159
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
21m 59s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
35.08
8.85116
9.41059
-0.2704
0.10447
0.37487
1.80706
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 24s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
37
8.85127
9.41059
-0.46101
0.22361
0.68461
1.88091
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 7s
-
-
-
sweep-testy-mc-test
linear
fp
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
38.28
8.85105
9.41059
0.23375
0.049722
0.18403
1.59097
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 25s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
38.92
8.85132
9.41059
0.54112
-0.28756
0.82868
1.90709
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
39.28
8.85124
9.41059
0.41808
0.12914
0.28894
1.72706
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 8s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
39.6
8.85111
9.41059
0.081225
-0.30875
0.38997
1.66809
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 32s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
42.08
8.85172
9.41059
0.97232
-0.57749
1.54981
1.93544
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 3s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
42.12
8.85152
9.41059
0.88873
-0.074187
0.96292
1.31192
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 27s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
42.68
8.85149
9.41059
-0.86473
-0.056159
0.80857
1.25818
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 4s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
42.76
8.85113
9.41059
-0.16078
0.20547
0.36625
1.98513
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 5s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
42.76
8.85183
9.41059
-1.1458
0.5745
1.72031
1.89069
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 7s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
43.2
8.85152
9.41059
-0.70897
0.52805
1.23702
1.97865
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 34s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
43.52
8.85136
9.41059
-0.63703
0.25644
0.89348
1.82113
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 20s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44
8.85141
9.41059
0.75765
0.24235
0.5153
1.73981
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 8s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
44
8.8515
9.41059
0.81667
-0.34849
1.16516
1.84061
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 14s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.04
8.85139
9.41059
0.73615
0.26385
0.47229
1.78078
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 1s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.08
8.85287
9.41059
0.83728
0.16272
0.67455
1.55918
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 18s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.12
8.85139
9.41059
0.7307
0.2693
0.4614
1.79062
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 27s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.2
8.8513
9.41059
0.58043
0.41957
0.16086
1.97418
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
21m 59s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.24
8.85131
9.41059
0.59755
0.40245
0.19511
1.96205
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 23s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.36
8.85157
9.41059
0.97317
0.026834
0.94633
1.13152
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 21s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.4
8.85143
9.41059
0.77013
0.22987
0.54025
1.71451
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 5s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.44
8.85147
9.41059
0.79352
0.20648
0.58705
1.66404
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 17s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.48
8.85144
9.41059
0.78117
0.21883
0.56234
1.69117
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.52
8.85157
9.41059
0.98407
0.015931
0.96814
1.08518
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 7s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.56
8.85154
9.41059
0.94534
0.054657
0.89069
1.23616
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.56
8.85132
9.41059
0.61479
0.38521
0.22958
1.94752
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 11s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.6
8.85154
9.41059
0.94356
0.056441
0.88712
1.24242
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
21m 59s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.6
8.85157
9.41059
0.98508
0.014922
0.97016
1.08064
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 9s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.6
8.85158
9.41059
0.98594
0.014058
0.97188
1.07671
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 31s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.6
8.85154
9.41059
0.94321
0.056786
0.88643
1.24363
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 24s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.6
8.85155
9.41059
0.9467
0.053295
0.89341
1.23134
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 23s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.64
8.85132
9.41059
0.61636
0.38364
0.23272
1.94608
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 13s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.64
8.85158
9.41059
0.98818
0.011821
0.97636
1.06632
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 26s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.68
8.8518
9.41059
0.82454
0.17546
0.64908
1.59112
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 23s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
44.76
8.85134
9.41059
0.41748
-0.48998
0.90746
1.99362
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 25s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.8
8.85158
9.41059
0.99375
0.006253
0.98749
1.0387
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
44.8
8.85168
9.41059
0.82013
0.17987
0.64025
1.60192
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
43m 34s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
44.92
8.85112
9.41059
-0.038475
-0.4323
0.39383
1.32706
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 20s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
45
8.85162
9.41059
0.85134
0.14866
0.70267
1.52254
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 3s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
45.16
8.85156
9.41059
0.80966
0.19034
0.61933
1.62695
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
45.2
8.85171
9.41059
-0.89252
0.67746
1.56998
1.98127
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 27s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
45.32
8.85127
9.41059
0.21127
0.78873
0.57745
1.67471
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 23s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
45.44
8.85127
9.41059
0.20601
0.79399
0.58797
1.66301
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 24s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
45.52
8.85127
9.41059
0.20165
0.79835
0.5967
1.65315
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 16s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
45.6
8.85127
9.41059
0.19732
0.80268
0.60536
1.64324
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 8s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
45.64
8.85141
9.41059
0.76249
0.36171
0.40078
1.87419
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 9s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
45.72
8.85131
9.41059
0.56211
0.43789
0.12422
1.98459
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 3s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
45.72
8.85131
9.41059
0.56217
0.43783
0.12433
1.98456
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 27s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
45.88
8.85128
9.41059
0.19133
0.80867
0.61733
1.6293
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 12s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
46.12
8.85131
9.41059
0.55822
0.44178
0.11644
1.98646
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 9s
-
-
-
sweep-testy-mc-test
linear
fp
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
46.16
8.85106
9.41059
-0.26591
-0.021032
0.24487
1.29964
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 24s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
46.2
8.85178
9.41059
-0.922
0.82423
1.74622
1.99687
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 7s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
46.2
8.85155
9.41059
0.9024
0.5788
0.3236
1.95246
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
46.44
8.85132
9.41059
0.6336
0.3664
0.26719
1.92902
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 7s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
46.44
8.85189
9.41059
1.50229
-0.012737
1.51502
1.04974
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 26s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
46.48
8.85172
9.41059
-1.19449
-0.44186
0.75263
1.79192
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 12s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
46.52
8.85154
9.41059
0.91703
0.082967
0.83407
1.33103
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 21s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
46.56
8.85154
9.41059
0.92046
0.079544
0.84091
1.32003
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 5s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
46.56
8.85153
9.41059
0.90804
0.091961
0.81608
1.35941
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 7s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
46.56
8.85154
9.41059
0.91975
0.080254
0.83949
1.32232
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 4s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
46.6
8.8513
9.41059
-0.09901
0.72212
0.82113
1.44495
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 12s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
46.64
8.85139
9.41059
-0.30891
-0.99391
0.685
1.72932
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 22s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
46.68
8.85133
9.41059
0.63668
0.36332
0.27337
1.92573
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
47
8.85133
9.41059
0.63811
0.36189
0.27621
1.92418
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 3s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
47.32
8.85138
9.41059
-0.60662
-0.50521
0.1014
1.99169
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 26s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
47.4
8.85172
9.41059
0.90534
-0.7202
1.62554
1.98704
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 27s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
47.4
8.85117
9.41059
0.17711
0.57115
0.39404
1.72848
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 12s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
47.48
8.85181
9.41059
-1.30386
-0.36708
0.93678
1.69301
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 11s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
47.52
8.85125
9.41059
0.28477
0.71523
0.43046
1.81739
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
47.8
8.85125
9.41059
0.24975
0.75025
0.5005
1.75428
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 27s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
47.84
8.85126
9.41059
0.24532
0.75468
0.50936
1.74567
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 23s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
47.92
8.8515
9.41059
0.8303
0.50818
0.32213
1.94235
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 9s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
48.12
8.85126
9.41059
0.23276
0.76724
0.53447
1.72046
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 10s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
48.24
8.85129
9.41059
0.1517
0.8483
0.6966
1.53058
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 11s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
48.28
8.8533
9.41059
1.40106
0.27071
1.13035
1.55715
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 14s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
48.32
8.8513
9.41059
0.16733
0.87612
0.70879
1.55313
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 15s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
48.36
8.85194
9.41059
1.10431
0.24078
0.86353
1.59981
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 17s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
48.48
8.85134
9.41059
0.66133
0.33867
0.32266
1.89677
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
48.48
8.85151
9.41059
-0.22653
1.11878
1.34531
1.57352
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 3s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
48.56
8.85128
9.41059
0.18657
0.81343
0.62686
1.61803
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 24s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
48.64
8.85146
9.41059
0.70701
0.58092
0.12609
1.99042
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 25s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
no_scale
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
48.72
8.85107
9.41059
0.090008
0.25819
0.16818
1.77088
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 28s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
49.72
8.85168
9.41059
-0.34463
-1.41088
1.06625
1.6409
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 28s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
no_scale
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
49.72
8.85109
9.41059
-0.19851
-0.15183
0.046671
1.98228
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 1s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
49.88
8.85151
9.41059
-0.17896
1.14457
1.32353
1.48615
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 22s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
50.2
8.85133
9.41059
0.65016
0.34984
0.30032
1.91047
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 7s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
50.2
8.85125
9.41059
0.3283
0.6717
0.34339
1.8832
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 20s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
50.24
8.85145
9.41059
-0.67253
-0.62905
0.043485
1.99888
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 25s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
50.24
8.8531
9.41059
-1.68247
-0.12066
1.56181
1.27838
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 3s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
50.32
8.8513
9.41059
0.14052
0.85948
0.71896
1.50066
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 21s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
50.32
8.85219
9.41059
1.76567
-0.40272
2.16839
1.61601
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
convex
50.64
8.85125
9.41059
0.33618
0.66382
0.32765
1.89357
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 25s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
50.92
8.85156
9.41059
0.21497
1.22698
1.012
1.52367
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
13m 27s
-
NVIDIA GeForce RTX 2070 SUPER
1
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
50.92
8.85176
9.41059
1.1836
0.67172
0.51187
1.92435
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
22m 6s
-
-
-
sweep-testy-mc-test
linear
fp_trivial
-
-
-
-
-
-
-
-
-
-
-
-
-
non_convex
51.04
8.85236
9.41059
1.82898
-0.64965
2.47863
1.77756
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
1-100
of 372


Created with ❤️ on Weights & Biases.

https://wandb.ai/ltorroba/exploring-inverse-kd/reports/Sweeps-for-2-3-experiments--VmlldzoxMzcyOTg4
Made with Weights & Biases. Sign up or log in to create reports like this one.