Skip to main content

Bayes+linearSVM, Bayes+k-NN

The worker here has the same average (over classes) reliability. The results show that k-NN sometimes beat linearSVM, especially when the risk threshold is low (=0.)
Created on July 10|Last edited on July 13

Linear SVM vs. k-NN

Different risk threshold

k-NN method is more resistant to low risk threshold




0.680.700.720.740.760.780.800.820.840.860.880.900.920.940.960.981.00bayes+cv_prior0.70.750.80.850.90.951bayes+k-NN
Risk threshold=0.
72
Risk threshold=0.7
0
Risk threshold=0.9
0


Different k

Large k performs better




k=5
361
k=10
0
k=50
0



Note that the workers here are all reliable to some extent.

What happened to linearSVM? (when risk threshold=0.)




Run set
5520


Overfit to the noisy label (# features=8092,# data =10*50=500)