Information hiding cameras: optical concealment of object information into ordinary images

• URL: http://arxiv.org/abs/2401.07856v1
• Date: Mon, 15 Jan 2024 17:37:27 GMT
• Title: Information hiding cameras: optical concealment of object information into ordinary images
• Authors: Bijie Bai, Ryan Lee, Yuhang Li, Tianyi Gan, Yuntian Wang, Mona Jarrahi, and Aydogan Ozcan
• Abstract summary: We introduce an optical information hiding camera integrated with an electronic decoder, jointly optimized through deep learning. This information hiding-decoding system employs a diffractive optical processor as its front-end, which transforms and hides input images in the form of ordinary-looking patterns that deceive/mislead human observers. By processing these ordinary-looking output images, a jointly-trained electronic decoder neural network accurately reconstructs the original information hidden within the deceptive output pattern.
• Score: 11.41487037469984
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Data protection methods like cryptography, despite being effective, inadvertently signal the presence of secret communication, thereby drawing undue attention. Here, we introduce an optical information hiding camera integrated with an electronic decoder, optimized jointly through deep learning. This information hiding-decoding system employs a diffractive optical processor as its front-end, which transforms and hides input images in the form of ordinary-looking patterns that deceive/mislead human observers. This information hiding transformation is valid for infinitely many combinations of secret messages, all of which are transformed into ordinary-looking output patterns, achieved all-optically through passive light-matter interactions within the optical processor. By processing these ordinary-looking output images, a jointly-trained electronic decoder neural network accurately reconstructs the original information hidden within the deceptive output pattern. We numerically demonstrated our approach by designing an information hiding diffractive camera along with a jointly-optimized convolutional decoder neural network. The efficacy of this system was demonstrated under various lighting conditions and noise levels, showing its robustness. We further extended this information hiding camera to multi-spectral operation, allowing the concealment and decoding of multiple images at different wavelengths, all performed simultaneously in a single feed-forward operation. The feasibility of our framework was also demonstrated experimentally using THz radiation. This optical encoder-electronic decoder-based co-design provides a novel information hiding camera interface that is both high-speed and energy-efficient, offering an intriguing solution for visual information security.

Related papers

• Revelio: A Real-World Screen-Camera Communication System with Visually Imperceptible Data Embedding [1.9924262168387745]
  We present Revelio', a real-world screen-camera communication system leveraging temporal flicker fusion in the OKLAB color space. Revelio achieves visually imperceptible data embedding while remaining robust against noise, asynchronicity, and distortions in screen-camera channels.
  arXiv  Detail & Related papers  (2025-01-04T18:05:08Z)
• Can Encrypted Images Still Train Neural Networks? Investigating Image Information and Random Vortex Transformation [51.475827684468875]
  We establish a novel framework for measuring image information content to evaluate the variation in information content during image transformations. We also propose a novel image encryption algorithm called Random Vortex Transformation.
  arXiv  Detail & Related papers  (2024-11-25T09:14:53Z)
• Lying mirror [18.41925837760181]
  We introduce an all-optical system, termed the "lying mirror", to hide input information by transforming it into misleading patterns. This misleading transformation is achieved through passive light-matter interactions of the incident light with an optimized structured diffractive surface. These lying mirror designs were shown to camouflage different types of input image data, exhibiting robustness against a range of adversarial manipulations.
  arXiv  Detail & Related papers  (2024-10-20T22:05:13Z)
• Neuromorphic Synergy for Video Binarization [54.195375576583864]
  Bimodal objects serve as a visual form to embed information that can be easily recognized by vision systems. Neuromorphic cameras offer new capabilities for alleviating motion blur, but it is non-trivial to first de-blur and then binarize the images in a real-time manner. We propose an event-based binary reconstruction method that leverages the prior knowledge of the bimodal target's properties to perform inference independently in both event space and image space. We also develop an efficient integration method to propagate this binary image to high frame rate binary video.
  arXiv  Detail & Related papers  (2024-02-20T01:43:51Z)
• Joint Sensing and Task-Oriented Communications with Image and Wireless Data Modalities for Dynamic Spectrum Access [49.83882366499547]
  This paper introduces a deep learning approach to dynamic spectrum access, leveraging the synergy of multi-modal image and spectrum data for the identification of potential transmitters. We consider an edge device equipped with a camera that is taking images of potential objects such as vehicles that may harbor transmitters. We propose a collaborative system wherein the edge device communicates selectively processed information to a trusted receiver acting as a fusion center.
  arXiv  Detail & Related papers  (2023-12-21T15:26:26Z)
• Nonlinear optical encoding enabled by recurrent linear scattering [16.952531256252744]
  We introduce a design that passively induce optical nonlinear random mapping with a continuous-wave laser at a low power. We demonstrate that our design retains vital information even when the readout dimensionality is reduced. This capability allows our optical platforms to offer efficient optical information processing solutions across applications.
  arXiv  Detail & Related papers  (2023-07-17T15:15:47Z)
• Human-imperceptible, Machine-recognizable Images [76.01951148048603]
  A major conflict is exposed relating to software engineers between better developing AI systems and distancing from the sensitive training data. This paper proposes an efficient privacy-preserving learning paradigm, where images are encrypted to become human-imperceptible, machine-recognizable'' We show that the proposed paradigm can ensure the encrypted images have become human-imperceptible while preserving machine-recognizable information.
  arXiv  Detail & Related papers  (2023-06-06T13:41:37Z)
• Learning Diffractive Optical Communication Around Arbitrary Opaque Occlusions [0.0]
  Free-space optical systems are emerging for high data rate communication and transfer of information in indoor and outdoor settings. Here, we demonstrate, for the first time, a direct communication scheme, passing optical information around a fully opaque, arbitrarily shaped obstacle. In this scheme, an electronic neural network encoder and a diffractive optical network decoder are jointly trained using deep learning.
  arXiv  Detail & Related papers  (2023-04-20T04:47:03Z)
• High-dimensional encryption in optical fibers using machine learning [0.0]
  We introduce a smart high-dimensional encryption protocol in which the propagation of spatial modes in multimode fibers is used as a natural mechanism for encryption. Our on-fiber communication platform allows us to use spatial modes of light for high-dimensional bit-by-bit and byte-by-byte encoding.
  arXiv  Detail & Related papers  (2021-08-13T22:36:33Z)
• Learning optical flow from still images [53.295332513139925]
  We introduce a framework to generate accurate ground-truth optical flow annotations quickly and in large amounts from any readily available single real picture. We virtually move the camera in the reconstructed environment with known motion vectors and rotation angles. When trained with our data, state-of-the-art optical flow networks achieve superior generalization to unseen real data.
  arXiv  Detail & Related papers  (2021-04-08T17:59:58Z)
• Rapid characterisation of linear-optical networks via PhaseLift [51.03305009278831]
  Integrated photonics offers great phase-stability and can rely on the large scale manufacturability provided by the semiconductor industry. New devices, based on such optical circuits, hold the promise of faster and energy-efficient computations in machine learning applications. We present a novel technique to reconstruct the transfer matrix of linear optical networks.
  arXiv  Detail & Related papers  (2020-10-01T16:04:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.