PASCAL VOC (IoU>0.5) evaluation on test-set NMS mode study
Created on October 19|Last edited on October 19
Comment
Metrics
All tests used NMS threshold 0.25, which seems to work well
"argmax" is clearly best for mAP and recall, for best precision one should use
- max_detections=1000
- top-k=50
- nms-mode="median"
There's a whopping +24% difference in precision with these settings vs. "argmax" at the expense of -4% recall
Though mAP metric seems to overly favor recall here... Although for SAR context recall is more important
Although median NMS seems to be very sensitive to the choice of num_detections and top-k, where "score_vote" is not, but gives slightly worse overall performance
Run set
25
Add a comment