Mirror-Yolo: A Novel Attention Focus, Instance Segmentation and Mirror Detection Model

• URL: http://arxiv.org/abs/2202.08498v3
• Date: Tue, 05 Nov 2024 03:29:58 GMT
• Title: Mirror-Yolo: A Novel Attention Focus, Instance Segmentation and Mirror Detection Model
• Authors: Fengze Li, Jieming Ma, Zhongbei Tian, Ji Ge, Hai-Ning Liang, Yungang Zhang, Tianxi Wen,
• Abstract summary: YOLOv4 achieves phenomenal results in terms of object detection accuracy and speed, but it still fails in detecting mirrors. We propose Mirror-YOLO, which targets mirror detection, containing a novel attention focus mechanism for features acquisition.
• Score: 6.048747739825864
• License:
• Abstract: Mirrors can degrade the performance of computer vision models, but research into detecting them is in the preliminary phase. YOLOv4 achieves phenomenal results in terms of object detection accuracy and speed, but it still fails in detecting mirrors. Thus, we propose Mirror-YOLO, which targets mirror detection, containing a novel attention focus mechanism for features acquisition, a hypercolumn-stairstep approach to better fusion the feature maps, and the mirror bounding polygons for instance segmentation. Compared to the existing mirror detection networks and YOLO series, our proposed network achieves superior performance in average accuracy on our proposed mirror dataset and another state-of-art mirror dataset, which demonstrates the validity and effectiveness of Mirror-YOLO.

Related papers

• Reflecting Reality: Enabling Diffusion Models to Produce Faithful Mirror Reflections [26.02117310176884]
  We tackle the problem of generating highly realistic and plausible mirror reflections using diffusion-based generative models. To enable this, we create SynMirror, a large-scale dataset of diverse synthetic scenes with objects placed in front of mirrors. We propose a novel depth-conditioned inpainting method called MirrorFusion, which generates high-quality geometrically consistent and photo-realistic mirror reflections.
  arXiv  Detail & Related papers  (2024-09-23T02:59:07Z)
• Spatial Transformer Network YOLO Model for Agricultural Object Detection [0.3124884279860061]
  We propose a new method that integrates spatial transformer networks (STNs) into YOLO to improve performance. The proposed STN-YOLO aims to enhance the model's effectiveness by focusing on important areas of the image. We apply the STN-YOLO on benchmark datasets for Agricultural object detection as well as a new dataset from a state-of-the-art plant phenotyping greenhouse facility.
  arXiv  Detail & Related papers  (2024-07-31T14:53:41Z)
• MirrorGaussian: Reflecting 3D Gaussians for Reconstructing Mirror Reflections [58.003014868772254]
  MirrorGaussian is the first method for mirror scene reconstruction with real-time rendering based on 3D Gaussian Splatting. We introduce an intuitive dual-rendering strategy that enables differentiableization of both the real-world 3D Gaussians and the mirrored counterpart. Our approach significantly outperforms existing methods, achieving state-of-the-art results.
  arXiv  Detail & Related papers  (2024-05-20T09:58:03Z)
• Learning mirror maps in policy mirror descent [12.792602427704391]
  Policy Mirror Descent (PMD) is a popular framework in reinforcement learning. Despite its popularity, the exploration of PMD's full potential is limited. We show that it is possible to learn a mirror map that outperforms the negative entropy in more complex environments.
  arXiv  Detail & Related papers  (2024-02-07T19:01:06Z)
• YOLO-World: Real-Time Open-Vocabulary Object Detection [87.08732047660058]
  We introduce YOLO-World, an innovative approach that enhances YOLO with open-vocabulary detection capabilities. Our method excels in detecting a wide range of objects in a zero-shot manner with high efficiency. YOLO-World achieves 35.4 AP with 52.0 FPS on V100, which outperforms many state-of-the-art methods in terms of both accuracy and speed.
  arXiv  Detail & Related papers  (2024-01-30T18:59:38Z)
• YOLO-MS: Rethinking Multi-Scale Representation Learning for Real-time Object Detection [80.11152626362109]
  We provide an efficient and performant object detector, termed YOLO-MS. We train our YOLO-MS on the MS COCO dataset from scratch without relying on any other large-scale datasets. Our work can also be used as a plug-and-play module for other YOLO models.
  arXiv  Detail & Related papers  (2023-08-10T10:12:27Z)
• Weakly-supervised Contrastive Learning for Unsupervised Object Discovery [52.696041556640516]
  Unsupervised object discovery is promising due to its ability to discover objects in a generic manner. We design a semantic-guided self-supervised learning model to extract high-level semantic features from images. We introduce Principal Component Analysis (PCA) to localize object regions.
  arXiv  Detail & Related papers  (2023-07-07T04:03:48Z)
• Efficient Mirror Detection via Multi-level Heterogeneous Learning [39.091162729266294]
  HetNet is a highly efficient mirror detection network. HetNet follows an effective architecture that obtains specific information at different stages to detect mirrors. Compared to the state-of-the-art method, HetNet runs 664$%$ faster and draws an average performance gain of 8.9$%$ on MAE, 3.1$%$ on IoU, and 2.0$%$ on F-measure.
  arXiv  Detail & Related papers  (2022-11-28T18:51:11Z)
• Symmetry-Aware Transformer-based Mirror Detection [85.47570468668955]
  We propose a dual-path Symmetry-Aware Transformer-based mirror detection Network (SATNet) SATNet includes two novel modules: Symmetry-Aware Attention Module (SAAM) and Contrast and Fusion Decoder Module (CFDM) Experimental results show that SATNet outperforms both RGB and RGB-D mirror detection methods on all available mirror detection datasets.
  arXiv  Detail & Related papers  (2022-07-13T16:40:01Z)
• A lightweight and accurate YOLO-like network for small target detection in Aerial Imagery [94.78943497436492]
  We present YOLO-S, a simple, fast and efficient network for small target detection. YOLO-S exploits a small feature extractor based on Darknet20, as well as skip connection, via both bypass and concatenation. YOLO-S has an 87% decrease of parameter size and almost one half FLOPs of YOLOv3, making practical the deployment for low-power industrial applications.
  arXiv  Detail & Related papers  (2022-04-05T16:29:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.