Wireless Image Retrieval at the Edge

• URL: http://arxiv.org/abs/2007.10915v2
• Date: Thu, 15 Jul 2021 08:31:42 GMT
• Title: Wireless Image Retrieval at the Edge
• Authors: Mikolaj Jankowski, Deniz Gunduz, Krystian Mikolajczyk
• Abstract summary: We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. We propose two alternative schemes based on digital and analog communications, respectively.
• Score: 20.45405359815043
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We study the image retrieval problem at the wireless edge, where an edge device captures an image, which is then used to retrieve similar images from an edge server. These can be images of the same person or a vehicle taken from other cameras at different times and locations. Our goal is to maximize the accuracy of the retrieval task under power and bandwidth constraints over the wireless link. Due to the stringent delay constraint of the underlying application, sending the whole image at a sufficient quality is not possible. We propose two alternative schemes based on digital and analog communications, respectively. In the digital approach, we first propose a deep neural network (DNN) aided retrieval-oriented image compression scheme, whose output bit sequence is transmitted over the channel using conventional channel codes. In the analog joint source and channel coding (JSCC) approach, the feature vectors are directly mapped into channel symbols. We evaluate both schemes on image based re-identification (re-ID) tasks under different channel conditions, including both static and fading channels. We show that the JSCC scheme significantly increases the end-to-end accuracy, speeds up the encoding process, and provides graceful degradation with channel conditions. The proposed architecture is evaluated through extensive simulations on different datasets and channel conditions, as well as through ablation studies.

Related papers

• DeepJSCC-Q: Constellation Constrained Deep Joint Source-Channel Coding [6.55705721360334]
  We show that DeepJSCC-Q can achieve similar performance to prior works that allow any complex valued channel input. DeepJSCC-Q preserves the graceful degradation of image quality in unpredictable channel conditions.
  arXiv  Detail & Related papers  (2022-06-16T11:43:50Z)
• Reducing Redundancy in the Bottleneck Representation of the Autoencoders [98.78384185493624]
  Autoencoders are a type of unsupervised neural networks, which can be used to solve various tasks. We propose a scheme to explicitly penalize feature redundancies in the bottleneck representation. We tested our approach across different tasks: dimensionality reduction using three different dataset, image compression using the MNIST dataset, and image denoising using fashion MNIST.
  arXiv  Detail & Related papers  (2022-02-09T18:48:02Z)
• Distributed Image Transmission using Deep Joint Source-Channel Coding [8.316711745589354]
  We study the problem of deep joint source-channel coding (D-JSCC) for correlated image sources. We propose a deep neural networks solution that includes lightweight edge encoders and a powerful center decoder. Our results show the impressive improvement of reconstruction quality in both links by exploiting the noisy representations of the other link.
  arXiv  Detail & Related papers  (2022-01-25T14:25:26Z)
• DeepJSCC-Q: Channel Input Constrained Deep Joint Source-Channel Coding [5.046831208137847]
  DeepJSCC-Q is an end-to-end optimized joint source-channel coding scheme for wireless image transmission. It preserves the graceful degradation of image quality observed in prior work when channel conditions worsen.
  arXiv  Detail & Related papers  (2021-11-25T11:59:17Z)
• FOVEA: Foveated Image Magnification for Autonomous Navigation [53.69803081925454]
  We propose an attentional approach that elastically magnifies certain regions while maintaining a small input canvas. Our proposed method boosts the detection AP over standard Faster R-CNN, with and without finetuning. On the autonomous driving datasets Argoverse-HD and BDD100K, we show our proposed method boosts the detection AP over standard Faster R-CNN, with and without finetuning.
  arXiv  Detail & Related papers  (2021-08-27T03:07:55Z)
• TBNet:Two-Stream Boundary-aware Network for Generic Image Manipulation Localization [49.521622399483846]
  We propose a novel end-to-end two-stream boundary-aware network (abbreviated as TBNet) for generic image manipulation localization. The proposed TBNet can significantly outperform state-of-the-art generic image manipulation localization methods in terms of both MCC and F1.
  arXiv  Detail & Related papers  (2021-08-10T08:22:05Z)
• Semi-Supervised Learning for Channel Charting-Aided IoT Localization in Millimeter Wave Networks [97.66522637417636]
  A novel framework is proposed for channel charting (CC)-aided localization in millimeter wave networks. In particular, a convolutional autoencoder model is proposed to estimate the three-dimensional location of wireless user equipment. The framework is extended to a semi-supervised framework, where the autoencoder is divided into two components.
  arXiv  Detail & Related papers  (2021-08-03T14:41:38Z)
• Deep Joint Transmission-Recognition for Multi-View Cameras [1.6244541005112747]
  We propose joint transmission-recognition schemes for efficient inference at the wireless edge. Motivated by the surveillance applications with wireless cameras, we consider the person classification task over a wireless channel carried out by multi-view cameras.
  arXiv  Detail & Related papers  (2020-11-03T18:27:49Z)
• Bandwidth-Agile Image Transmission with Deep Joint Source-Channel Coding [7.081604594416339]
  We consider the scenario in which images are transmitted progressively in layers over time or frequency. DeepJSCC-$l$ is an innovative solution that uses convolutional autoencoders. DeepJSCC-$l$ has comparable performance with state of the art digital progressive transmission schemes in the challenging low signal-to-noise ratio (SNR) and small bandwidth regimes.
  arXiv  Detail & Related papers  (2020-09-26T00:11:50Z)
• Channel-Level Variable Quantization Network for Deep Image Compression [50.3174629451739]
  We propose a channel-level variable quantization network to dynamically allocate more convolutions for significant channels and withdraws for negligible channels. Our method achieves superior performance and can produce much better visual reconstructions.
  arXiv  Detail & Related papers  (2020-07-15T07:20:39Z)
• DeepSIC: Deep Soft Interference Cancellation for Multiuser MIMO Detection [98.43451011898212]
  In multiuser multiple-input multiple-output (MIMO) setups, where multiple symbols are simultaneously transmitted, accurate symbol detection is challenging. We propose a data-driven implementation of the iterative soft interference cancellation (SIC) algorithm which we refer to as DeepSIC. DeepSIC learns to carry out joint detection from a limited set of training samples without requiring the channel to be linear.
  arXiv  Detail & Related papers  (2020-02-08T18:31:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.