Analysis of ROC for Edge Detectors
- URL: http://arxiv.org/abs/2305.17820v1
- Date: Sun, 28 May 2023 22:47:54 GMT
- Title: Analysis of ROC for Edge Detectors
- Authors: Kai Yi Ji
- Abstract summary: This paper presents an evaluation of edge detectors using receiver operating characteristic (ROC) analysis on the BIPED dataset.
We observed that while ROC analysis is suitable for certain edge filters, it presents challenges when accurately measuring their performance using ROC metrics.
To address this issue, we introduce customization techniques to enhance the performance of these filters, enabling more accurate evaluation.
- Score: 14.494626833445915
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper presents an evaluation of edge detectors using receiver operating
characteristic (ROC) analysis on the BIPED dataset. Our study examines the
benefits and drawbacks of applying this technique in Matlab. We observed that
while ROC analysis is suitable for certain edge filters, but for filters such
as Laplacian, Laplacian of Gaussian, and Canny, it presents challenges when
accurately measuring their performance using ROC metrics. To address this
issue, we introduce customization techniques to enhance the performance of
these filters, enabling more accurate evaluation. Through our customization
efforts, we achieved improved results, ultimately facilitating a comprehensive
assessment of the edge detectors.
Related papers
- The Effectiveness of Edge Detection Evaluation Metrics for Automated Coastline Detection [2.5311562666866494]
We evaluate RMSE, PSNR, SSIM and FOM for automated coastline detection.
We apply Canny edge detection to 95 coastline satellite images across 49 testing locations.
FOM was the most reliable metric for selecting the best threshold.
arXiv Detail & Related papers (2024-05-19T09:51:10Z) - The curious case of the test set AUROC [0.5242869847419834]
We argue that considering scores derived from the test ROC curve alone gives only a narrow insight into how a model performs and its ability to generalise.
arXiv Detail & Related papers (2023-12-19T17:40:58Z) - Experimental analysis regarding the influence of iris segmentation on
the recognition rate [64.02126624793775]
The authors will examine whether the segmentation accuracy, based on a ground truth, can serve as a predictor for the overall performance of the iris-biometric tool chain.
arXiv Detail & Related papers (2022-11-10T11:59:51Z) - Assessment of Treatment Effect Estimators for Heavy-Tailed Data [70.72363097550483]
A central obstacle in the objective assessment of treatment effect (TE) estimators in randomized control trials (RCTs) is the lack of ground truth (or validation set) to test their performance.
We provide a novel cross-validation-like methodology to address this challenge.
We evaluate our methodology across 709 RCTs implemented in the Amazon supply chain.
arXiv Detail & Related papers (2021-12-14T17:53:01Z) - Stochastic Optimization of Areas Under Precision-Recall Curves with
Provable Convergence [66.83161885378192]
Area under ROC (AUROC) and precision-recall curves (AUPRC) are common metrics for evaluating classification performance for imbalanced problems.
We propose a technical method to optimize AUPRC for deep learning.
arXiv Detail & Related papers (2021-04-18T06:22:21Z) - Detection of Adversarial Supports in Few-shot Classifiers Using Feature
Preserving Autoencoders and Self-Similarity [89.26308254637702]
We propose a detection strategy to highlight adversarial support sets.
We make use of feature preserving autoencoder filtering and also the concept of self-similarity of a support set to perform this detection.
Our method is attack-agnostic and also the first to explore detection for few-shot classifiers to the best of our knowledge.
arXiv Detail & Related papers (2020-12-09T14:13:41Z) - Unmixing Convolutional Features for Crisp Edge Detection [28.232800355331726]
This paper presents a context-aware tracing strategy (CATS) for crisp edge detection with deep edge detectors.
Experiments demonstrate that the proposed CATS can be integrated into modern deep edge detectors to improve localization accuracy.
arXiv Detail & Related papers (2020-11-19T13:30:15Z) - Dense Label Encoding for Boundary Discontinuity Free Rotation Detection [69.75559390700887]
This paper explores a relatively less-studied methodology based on classification.
We propose new techniques to push its frontier in two aspects.
Experiments and visual analysis on large-scale public datasets for aerial images show the effectiveness of our approach.
arXiv Detail & Related papers (2020-11-19T05:42:02Z) - Line-Circle-Square (LCS): A Multilayered Geometric Filter for Edge-Based
Detection [2.4054377316708964]
The proposed filter applies detection, tracking and learning to each defined expert to extract higher level information for judging scenes without over-calculation.
The experiment validates the effectiveness of the proposed filter in terms of detection precision and resource usage in both experimental and real-world scenarios.
arXiv Detail & Related papers (2020-08-21T05:28:12Z) - Refined Plane Segmentation for Cuboid-Shaped Objects by Leveraging Edge
Detection [63.942632088208505]
We propose a post-processing algorithm to align the segmented plane masks with edges detected in the image.
This allows us to increase the accuracy of state-of-the-art approaches, while limiting ourselves to cuboid-shaped objects.
arXiv Detail & Related papers (2020-03-28T18:51:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.