Related papers: Multiscale IoU: A Metric for Evaluation of Salient Object Detection with Fine Structures

Multiscale IoU: A Metric for Evaluation of Salient Object Detection with Fine Structures

URL: http://arxiv.org/abs/2105.14572v1
Date: Sun, 30 May 2021 15:31:42 GMT
Title: Multiscale IoU: A Metric for Evaluation of Salient Object Detection with Fine Structures
Authors: Azim Ahmadzadeh, Dustin J. Kempton, Yang Chen, Rafal A. Angryk
Abstract summary: General-purpose object-detection algorithms often dismiss the fine structure of detected objects. We present a new metric that is a marriage of a popular evaluation metric, namely Intersection over Union (IoU), and a geometrical concept, called fractal dimension. We show that MIoU is indeed sensitive to the fine boundary structures which are completely overlooked by IoU and f1-score.
Score: 5.098461305284216
License: http://creativecommons.org/licenses/by-nc-sa/4.0/
Abstract: General-purpose object-detection algorithms often dismiss the fine structure of detected objects. This can be traced back to how their proposed regions are evaluated. Our goal is to renegotiate the trade-off between the generality of these algorithms and their coarse detections. In this work, we present a new metric that is a marriage of a popular evaluation metric, namely Intersection over Union (IoU), and a geometrical concept, called fractal dimension. We propose Multiscale IoU (MIoU) which allows comparison between the detected and ground-truth regions at multiple resolution levels. Through several reproducible examples, we show that MIoU is indeed sensitive to the fine boundary structures which are completely overlooked by IoU and f1-score. We further examine the overall reliability of MIoU by comparing its distribution with that of IoU on synthetic and real-world datasets of objects. We intend this work to re-initiate exploration of new evaluation methods for object-detection algorithms.

Related papers

Size-invariance Matters: Rethinking Metrics and Losses for Imbalanced Multi-object Salient Object Detection [133.66006666465447]
Current metrics are size-sensitive, where larger objects are focused, and smaller ones tend to be ignored. We argue that the evaluation should be size-invariant because bias based on size is unjustified without additional semantic information. We develop an optimization framework tailored to this goal, achieving considerable improvements in detecting objects of different sizes.
arXiv Detail & Related papers (2024-05-16T03:01:06Z)
Learning Feature Inversion for Multi-class Anomaly Detection under General-purpose COCO-AD Benchmark [101.23684938489413]
Anomaly detection (AD) is often focused on detecting anomalies for industrial quality inspection and medical lesion examination. This work first constructs a large-scale and general-purpose COCO-AD dataset by extending COCO to the AD field. Inspired by the metrics in the segmentation field, we propose several more practical threshold-dependent AD-specific metrics.
arXiv Detail & Related papers (2024-04-16T17:38:26Z)
Weakly-supervised Contrastive Learning for Unsupervised Object Discovery [52.696041556640516]
Unsupervised object discovery is promising due to its ability to discover objects in a generic manner. We design a semantic-guided self-supervised learning model to extract high-level semantic features from images. We introduce Principal Component Analysis (PCA) to localize object regions.
arXiv Detail & Related papers (2023-07-07T04:03:48Z)
Spatial Reasoning for Few-Shot Object Detection [21.3564383157159]
We propose a spatial reasoning framework that detects novel objects with only a few training examples in a context. We employ a graph convolutional network as the RoIs and their relatedness are defined as nodes and edges, respectively. We demonstrate that the proposed method significantly outperforms the state-of-the-art methods and verify its efficacy through extensive ablation studies.
arXiv Detail & Related papers (2022-11-02T12:38:08Z)
Graph Fusion Network for Multi-Oriented Object Detection [15.451824121019449]
We propose a novel graph fusion network, named GFNet, for multi-oriented object detection. Our GFNet is adaptively fuse dense detection boxes to detect more accurate and holistic multi-oriented object instances.
arXiv Detail & Related papers (2022-05-07T05:47:22Z)
A Normalized Gaussian Wasserstein Distance for Tiny Object Detection [21.50800336432307]
State-of-the-art detectors do not produce satisfactory results on tiny objects due to lack of appearance information. We propose a new evaluation metric using Wasserstein distance for tiny object detection.
arXiv Detail & Related papers (2021-10-26T03:43:17Z)
Boundary IoU: Improving Object-Centric Image Segmentation Evaluation [125.20898025044804]
We present Boundary IoU, a new segmentation evaluation measure focused on boundary quality. Boundary IoU is significantly more sensitive than the standard Mask IoU measure to boundary errors for large objects and does not over-penalize errors on smaller objects.
arXiv Detail & Related papers (2021-03-30T17:59:20Z)
Slender Object Detection: Diagnoses and Improvements [74.40792217534]
In this paper, we are concerned with the detection of a particular type of objects with extreme aspect ratios, namely textbfslender objects. For a classical object detection method, a drastic drop of $18.9%$ mAP on COCO is observed, if solely evaluated on slender objects.
arXiv Detail & Related papers (2020-11-17T09:39:42Z)
Universal-RCNN: Universal Object Detector via Transferable Graph R-CNN [117.80737222754306]
We present a novel universal object detector called Universal-RCNN. We first generate a global semantic pool by integrating all high-level semantic representation of all the categories. An Intra-Domain Reasoning Module learns and propagates the sparse graph representation within one dataset guided by a spatial-aware GCN.
arXiv Detail & Related papers (2020-02-18T07:57:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.