Matching Non-Identical Objects

• URL: http://arxiv.org/abs/2403.08227v3
• Date: Mon, 09 Dec 2024 12:46:14 GMT
• Title: Matching Non-Identical Objects
• Authors: Yusuke Marumo, Kazuhiko Kawamoto, Satomi Tanaka, Shigenobu Hirano, Hiroshi Kera,
• Abstract summary: This study addresses a novel task of matching such non-identical objects at the pixel level.<n>We propose a weighting scheme of descriptors that incorporates semantic information from object detectors into existing sparse image matching methods.
• Score: 4.520518890664213
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Not identical but similar objects are ubiquitous in our world, ranging from four-legged animals such as dogs and cats to cars of different models and flowers of various colors. This study addresses a novel task of matching such non-identical objects at the pixel level. We propose a weighting scheme of descriptors that incorporates semantic information from object detectors into existing sparse image matching methods, extending their targets from identical objects captured from different perspectives to semantically similar objects. The experiments show successful matching between non-identical objects in various cases, including in-class design variations, class discrepancy, and domain shifts (e.g., photo--drawing and image corruptions).

Related papers

• A Dataset and Framework for Learning State-invariant Object Representations [0.6577148087211809]
  We present a novel dataset, ObjectsWithStateChange, which captures state and pose variations in the object images recorded from arbitrary viewpoints. Our ablation related to the role played by curriculum learning indicates an improvement in object recognition accuracy of 7.9% and retrieval mAP of 9.2% over the state-of-the-art on our new dataset.
  arXiv  Detail & Related papers  (2024-04-09T17:17:48Z)
• Interpretable Measures of Conceptual Similarity by Complexity-Constrained Descriptive Auto-Encoding [112.0878081944858]
  Quantifying the degree of similarity between images is a key copyright issue for image-based machine learning. We seek to define and compute a notion of "conceptual similarity" among images that captures high-level relations. Two highly dissimilar images can be discriminated early in their description, whereas conceptually dissimilar ones will need more detail to be distinguished.
  arXiv  Detail & Related papers  (2024-02-14T03:31:17Z)
• Are These the Same Apple? Comparing Images Based on Object Intrinsics [27.43687450076182]
  Measure image similarity purely based on intrinsic object properties that define object identity. This problem has been studied in the computer vision literature as re-identification. We propose to extend it to general object categories, exploring an image similarity metric based on object intrinsics.
  arXiv  Detail & Related papers  (2023-11-01T18:00:03Z)
• Taken by Surprise: Contrast effect for Similarity Scores [0.0]
  We propose an ensemble-normalized similarity metric that encapsulates the contrast effect of human perception. This score quantifies the surprise to find a given similarity between two elements relative to the pairwise ensemble similarities. We evaluate this metric on zero/few shot classification and clustering tasks and typically find 10-15 % better performance compared to raw cosine similarity.
  arXiv  Detail & Related papers  (2023-08-18T18:18:55Z)
• Perceive, Excavate and Purify: A Novel Object Mining Framework for Instance Segmentation [4.375012768093524]
  We propose a novel object mining framework for instance segmentation. We first introduce the semantics perceiving subnetwork to capture pixels that may belong to an obvious instance from the bottom up. In the mechanism, preliminary perceived semantics are regarded as original instances with classifications and locations, and then indistinguishable objects around these original instances are mined.
  arXiv  Detail & Related papers  (2023-04-18T08:47:03Z)
• Seeing a Rose in Five Thousand Ways [48.39141583352746]
  A rose comprises its intrinsics, including the distribution of geometry, texture, and material specific to its object category. We build a generative model that learns to capture such object intrinsics from a single image. Our method achieves superior results on multiple downstream tasks, including intrinsic image decomposition, shape and image generation, view synthesis, and relighting.
  arXiv  Detail & Related papers  (2022-12-09T16:24:37Z)
• Compositional Scene Modeling with Global Object-Centric Representations [44.43366905943199]
  Humans can easily identify the same object, even if occlusions exist, by completing the occluded parts based on its canonical image in the memory. This paper proposes a compositional scene modeling method to infer global representations of canonical images of objects without any supervision.
  arXiv  Detail & Related papers  (2022-11-21T14:36:36Z)
• Attributable Visual Similarity Learning [90.69718495533144]
  This paper proposes an attributable visual similarity learning (AVSL) framework for a more accurate and explainable similarity measure between images. Motivated by the human semantic similarity cognition, we propose a generalized similarity learning paradigm to represent the similarity between two images with a graph. Experiments on the CUB-200-2011, Cars196, and Stanford Online Products datasets demonstrate significant improvements over existing deep similarity learning methods.
  arXiv  Detail & Related papers  (2022-03-28T17:35:31Z)
• Contrastive Object Detection Using Knowledge Graph Embeddings [72.17159795485915]
  We compare the error statistics of the class embeddings learned from a one-hot approach with semantically structured embeddings from natural language processing or knowledge graphs. We propose a knowledge-embedded design for keypoint-based and transformer-based object detection architectures.
  arXiv  Detail & Related papers  (2021-12-21T17:10:21Z)
• Learning Contrastive Representation for Semantic Correspondence [150.29135856909477]
  We propose a multi-level contrastive learning approach for semantic matching. We show that image-level contrastive learning is a key component to encourage the convolutional features to find correspondence between similar objects.
  arXiv  Detail & Related papers  (2021-09-22T18:34:14Z)
• Category Contrast for Unsupervised Domain Adaptation in Visual Tasks [92.9990560760593]
  We propose a novel Category Contrast technique (CaCo) that introduces semantic priors on top of instance discrimination for visual UDA tasks. CaCo is complementary to existing UDA methods and generalizable to other learning setups such as semi-supervised learning, unsupervised model adaptation, etc.
  arXiv  Detail & Related papers  (2021-06-05T12:51:35Z)
• Fully Convolutional Geometric Features for Category-level Object Alignment [12.741811850885309]
  This paper focuses on pose registration of different object instances from the same category. Our approach transforms instances of the same category to a normalized canonical coordinate frame and uses metric learning to train fully convolutional geometric features.
  arXiv  Detail & Related papers  (2021-03-08T00:31:56Z)
• A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection [56.82077636126353]
  We take advantage of object-centric images to improve object detection in scene-centric images. We present a simple yet surprisingly effective framework to do so. Our approach can improve the object detection (and instance segmentation) accuracy of rare objects by 50% (and 33%) relatively.
  arXiv  Detail & Related papers  (2021-02-17T17:27:21Z)
• Continuous Surface Embeddings [76.86259029442624]
  We focus on the task of learning and representing dense correspondences in deformable object categories. We propose a new, learnable image-based representation of dense correspondences. We demonstrate that the proposed approach performs on par or better than the state-of-the-art methods for dense pose estimation for humans.
  arXiv  Detail & Related papers  (2020-11-24T22:52:15Z)
• Few-shot Visual Reasoning with Meta-analogical Contrastive Learning [141.2562447971]
  We propose to solve a few-shot (or low-shot) visual reasoning problem, by resorting to analogical reasoning. We extract structural relationships between elements in both domains, and enforce them to be as similar as possible with analogical learning. We validate our method on RAVEN dataset, on which it outperforms state-of-the-art method, with larger gains when the training data is scarce.
  arXiv  Detail & Related papers  (2020-07-23T14:00:34Z)
• Improving Object Detection with Selective Self-supervised Self-training [62.792445237541145]
  We study how to leverage Web images to augment human-curated object detection datasets. We retrieve Web images by image-to-image search, which incurs less domain shift from the curated data than other search methods. We propose a novel learning method motivated by two parallel lines of work that explore unlabeled data for image classification.
  arXiv  Detail & Related papers  (2020-07-17T18:05:01Z)
• A Survey on Instance Segmentation: State of the art [1.8782750537161614]
  Instance segmentation is the technique of simultaneously solving the problem of object detection as well as that of semantic segmentation. The paper provides valuable information for those who want to do research in the field of instance segmentation.
  arXiv  Detail & Related papers  (2020-06-28T14:39:20Z)
• On Equivariant and Invariant Learning of Object Landmark Representations [36.214069685880986]
  We develop a simple and effective approach by combining instance-discriminative and spatially-discriminative contrastive learning. We show that when a deep network is trained to be invariant to geometric and photometric transformations, representations emerge from its intermediate layers that are highly predictive of object landmarks.
  arXiv  Detail & Related papers  (2020-06-26T04:06:56Z)
• Self-supervised Single-view 3D Reconstruction via Semantic Consistency [142.71430568330172]
  We learn a self-supervised, single-view 3D reconstruction model that predicts the shape, texture and camera pose of a target object. The proposed method does not necessitate 3D supervision, manually annotated keypoints, multi-view images of an object or a prior 3D template.
  arXiv  Detail & Related papers  (2020-03-13T20:29:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.