Six-channel Image Representation for Cross-domain Object Detection

• URL: http://arxiv.org/abs/2101.00561v1
• Date: Sun, 3 Jan 2021 04:50:03 GMT
• Title: Six-channel Image Representation for Cross-domain Object Detection
• Authors: Tianxiao Zhang, Wenchi Ma, Guanghui Wang
• Abstract summary: Deep learning models are data-driven and the excellent performance is highly dependent on the abundant and diverse datasets. Some image-to-image translation techniques are employed to generate some fake data of some specific scenes to train the models. We propose to inspire the original 3-channel images and their corresponding GAN-generated fake images to form 6-channel representations of the dataset.
• Score: 17.854940064699985
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Most deep learning models are data-driven and the excellent performance is highly dependent on the abundant and diverse datasets. However, it is very hard to obtain and label the datasets of some specific scenes or applications. If we train the detector using the data from one domain, it cannot perform well on the data from another domain due to domain shift, which is one of the big challenges of most object detection models. To address this issue, some image-to-image translation techniques are employed to generate some fake data of some specific scenes to train the models. With the advent of Generative Adversarial Networks (GANs), we could realize unsupervised image-to-image translation in both directions from a source to a target domain and from the target to the source domain. In this study, we report a new approach to making use of the generated images. We propose to concatenate the original 3-channel images and their corresponding GAN-generated fake images to form 6-channel representations of the dataset, hoping to address the domain shift problem while exploiting the success of available detection models. The idea of augmented data representation may inspire further study on object detection and other applications.

Related papers

• Community Forensics: Using Thousands of Generators to Train Fake Image Detectors [15.166026536032142]
  One of the key challenges of detecting AI-generated images is spotting images that have been created by previously unseen generative models. We propose a new dataset that is significantly larger and more diverse than prior work. The resulting dataset contains 2.7M images that have been sampled from 4803 different models.
  arXiv  Detail & Related papers  (2024-11-06T18:59:41Z)
• Cross-domain and Cross-dimension Learning for Image-to-Graph Transformers [50.576354045312115]
  Direct image-to-graph transformation is a challenging task that solves object detection and relationship prediction in a single model. We introduce a set of methods enabling cross-domain and cross-dimension transfer learning for image-to-graph transformers. We demonstrate our method's utility in cross-domain and cross-dimension experiments, where we pretrain our models on 2D satellite images before applying them to vastly different target domains in 2D and 3D.
  arXiv  Detail & Related papers  (2024-03-11T10:48:56Z)
• Transfer learning with generative models for object detection on limited datasets [1.4999444543328293]
  In some fields, such as marine biology, it is necessary to have correctly labeled bounding boxes around each object. We propose a transfer learning framework that is valid for a generic scenario. Our results pave the way for new generative AI-based protocols for machine learning applications in various domains.
  arXiv  Detail & Related papers  (2024-02-09T21:17:31Z)
• Domain Bridge: Generative model-based domain forensic for black-box models [20.84645356097581]
  We introduce an enhanced approach to determine not just the general data domain but also its specific attributes. Our approach uses an image embedding model as the encoder and a generative model as the decoder. A key strength of our approach lies in leveraging the expansive dataset, LAION-5B, on which the generative model Stable Diffusion is trained.
  arXiv  Detail & Related papers  (2024-02-07T07:57:43Z)
• Weakly-supervised deepfake localization in diffusion-generated images [4.548755617115687]
  We propose a weakly-supervised localization problem based on the Xception network as the backbone architecture. We show that the best performing detection method (based on local scores) is less sensitive to the looser supervision than to the mismatch in terms of dataset or generator.
  arXiv  Detail & Related papers  (2023-11-08T10:27:36Z)
• Scrape, Cut, Paste and Learn: Automated Dataset Generation Applied to Parcel Logistics [58.720142291102135]
  We present a fully automated pipeline to generate a synthetic dataset for instance segmentation in four steps. We first scrape images for the objects of interest from popular image search engines. We compare three different methods for image selection: Object-agnostic pre-processing, manual image selection and CNN-based image selection.
  arXiv  Detail & Related papers  (2022-10-18T12:49:04Z)
• Deepfake Network Architecture Attribution [23.375381198124014]
  Existing works on fake image attribution perform multi-class classification on several Generative Adversarial Network (GAN) models. We present the first study on textitDeepfake Network Architecture Attribution to attribute fake images on architecture-level.
  arXiv  Detail & Related papers  (2022-02-28T14:54:30Z)
• Auto-Transfer: Learning to Route Transferrable Representations [77.30427535329571]
  We propose a novel adversarial multi-armed bandit approach which automatically learns to route source representations to appropriate target representations. We see upwards of 5% accuracy improvements compared with the state-of-the-art knowledge transfer methods.
  arXiv  Detail & Related papers  (2022-02-02T13:09:27Z)
• InvGAN: Invertible GANs [88.58338626299837]
  InvGAN, short for Invertible GAN, successfully embeds real images to the latent space of a high quality generative model. This allows us to perform image inpainting, merging, and online data augmentation.
  arXiv  Detail & Related papers  (2021-12-08T21:39:00Z)
• Learning Co-segmentation by Segment Swapping for Retrieval and Discovery [67.6609943904996]
  The goal of this work is to efficiently identify visually similar patterns from a pair of images. We generate synthetic training pairs by selecting object segments in an image and copy-pasting them into another image. We show our approach provides clear improvements for artwork details retrieval on the Brueghel dataset.
  arXiv  Detail & Related papers  (2021-10-29T16:51:16Z)
• Deep Domain-Adversarial Image Generation for Domain Generalisation [115.21519842245752]
  Machine learning models typically suffer from the domain shift problem when trained on a source dataset and evaluated on a target dataset of different distribution. To overcome this problem, domain generalisation (DG) methods aim to leverage data from multiple source domains so that a trained model can generalise to unseen domains. We propose a novel DG approach based on emphDeep Domain-Adversarial Image Generation (DDAIG)
  arXiv  Detail & Related papers  (2020-03-12T23:17:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.