Skip to main content

Which Dataset is relevant

Dataset can either be (i) representative of wikidata and have 20% qualifier info (ii) agnostic of real wikidata and have 100% qualifier info.
Created on September 9|Last edited on September 9

When using 20% qualifier data




05001k1.5k2kStep0.20.210.220.230.240.25
05001k1.5k2kStep900100011001200130014001500
05001k1.5k2kStep0.250.260.270.28
02004006008001kStep0.10.150.20.250.30.35
05001k1.5k2kStep0.10.110.120.130.140.150.16
Run set 1
2
Tags
Sweep
ENT_POS_FILTERED
MARGIN_LOSS
val_acc
val_hits@10
val_hits@3
val_hits@5
val_mr
val_mrr
wd15k_quints
-
true
6
0.16723
0.4085
0.28875
0.33862
830.16571
0.25202
wd15k_quints
-
false
6
0.16633
0.4038
0.28742
0.33526
883.04093
0.24997
evaluating_on_02
inflecting_024
wd15k_quints
-
true
5
0.15564
0.3913
0.27816
0.32604
932.83876
0.2397
evaluating_on_02
inflecting_024
wd15k_quints
-
true
6
0.16305
0.3931
0.2792
0.32686
850.5136
0.24399
evaluating_on_02
inflecting_024
wd15k_quints
-
false
5
0.15873
0.3856
0.27607
0.3214
1025.75754
0.23961
wd15k_quints
-
true
5
0.14843
0.37967
0.26665
0.31459
920.68273
0.23049
wd15k_quints
-
false
5
0.15029
0.37842
0.26661
0.31347
1010.53006
0.2308
evaluating_on_024
wd15k_quints
-
false
5
0.38651
0.55374
0.47187
0.50591
749.93022
0.44573
inflecting_02
wd15k_quints
-
true
7
0.1365
0.35097
0.23609
0.28432
824.23174
0.21045
inflecting4
wd15k_quints
-
true
5
0.14855
0.37397
0.26487
0.31138
933.17989
0.22883
1-10
of 17


When using a 100% qualifier data




Run set 1
3


WikiPeople




Run set 1
3