Skip to main content

SAR evaluation on test set with different NMS modes

Created on October 19|Last edited on October 19

Metrics

In terms of mAP "enclose" and "argmax" perform close to each other but "enclose" clearly beats "argmax" in precision

Key finding: if mode is not "argmax" i.e. NMS is baked into inference model, "num_detections" needs to be a lot larger in order to not drop any detections!

Now "enclose" is the obvious NMS mode to use with this type of evaluation.




heridaleva...argmaxenclosemedianscore_votenms...0.000.050.100.150.200.250.300.350.400.450.50iou...00nms...00sco...0.550.600.650.700.750.800.850.90tes...0.550.600.650.700.750.800.850.900.951.00tes...0.450.500.550.600.650.700.750.800.850.90tes...
sleek-elevator-750logical-dream-748whole-puddle-746rosy-grass-745laced-puddle-744radiant-bird-743deep-river-742fragrant-tree-741copper-star-740olive-cosmos-7390100200
sleek-elevator-750logical-dream-748whole-puddle-746rosy-grass-745laced-puddle-744radiant-bird-743deep-river-742fragrant-tree-741copper-star-740olive-cosmos-7390.00.5
Run set
12