Paper ID | MLR-APPL-IP-3.4 | ||
Paper Title | Multiscale IoU: A Metric for Evaluation of Salient Object Detection with Fine Structures | ||
Authors | Azim Ahmadzadeh, Dustin J. Kempton, Yang Chen, Rafal A. Angryk, Georgia State University, United States | ||
Session | MLR-APPL-IP-3: Machine learning for image processing 3 | ||
Location | Area F | ||
Session Time: | Tuesday, 21 September, 08:00 - 09:30 | ||
Presentation Time: | Tuesday, 21 September, 08:00 - 09:30 | ||
Presentation | Poster | ||
Topic | Applications of Machine Learning: Machine learning for image processing | ||
IEEE Xplore Open Preview | Click here to view in IEEE Xplore | ||
Abstract | Increasingly, general-purpose object-detection algorithms are being applied to detection tasks of singular focus, where their generality poses some limitations. The coarse segmentation of objects is one of these limitations, and can be traced back to how we evaluate their detection precision. Recognizing the value of this generality, and the limited use of task-specific algorithms, our goal is to re-negotiate this trade-off and close the gap between these two worlds. In this work, we present a new metric that is a marriage of a popular evaluation metric, named Intersection over Union (IoU), and fractal dimension. Using the ideas behind these concepts, we propose Multiscale IoU (MIoU) which allows comparison of the detected and ground-truth regions at multiple resolution levels. Through several examples, we show that MIoU is indeed sensitive to the fine boundary structures which can be completely overlooked by other region-based metrics. We further examine the reliability of MIoU using synthetic and real-world datasets of objects, and show that its values follow the same distribution as those of IoU do. We intend this work (with reproducible experiments) to re-initiate exploration of new evaluation methods for object-detection algorithms. |