SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstruction

• URL: http://arxiv.org/abs/2606.03940v1
• Date: Tue, 02 Jun 2026 17:28:28 GMT
• Title: SEAOTTER: Sensor Embedded Autoencoding with One-Time Transcode for Efficient Reconstruction
• Abstract summary: In robotics systems, vast amounts of visual data are easily captured at high resolution using low-cost, low-power hardware.<n>We introduce a compression framework for cloud based on a Sensor Embedded Autoencoder paired with a One-Time Transcode for Efficient Reconstruction.<n>At a compression ratio of 200:1, we observe 7 times faster encoding, 3.5 times faster decoding, and +8% ImageNet top-1 accuracy.
• Score: 0.7448254811651419
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In robotics systems, vast amounts of visual data are easily captured at high resolution using low-cost, low-power hardware. Yet, limited bandwidth and on-device compute resources prevent full utilization when transmitted via conventional codecs like JPEG/MPEG. Newer codecs, like AV1/AVIF, improve the rate-distortion trade-off, but demand far more resources for encoding, impractical without custom ASICs. Recent asymmetric autoencoders deliver high quality under extreme power and bandwidth constraints, but add prohibitive decoding cost and use bespoke formats that ignore decades of infrastructure built around standards like JPEG. To address these limitations, we introduce a compression framework for cloud robotics based on a Sensor Embedded Autoencoder paired with a One-Time Transcode for Efficient Reconstruction (SEAOTTER). Because the sensor, cloud, and consumer stages face very different power and bandwidth budgets, SEAOTTER combines the compactness of a learned latent with the broad usability of a standard JPEG file. Since naive transcoding degrades performance, we propose a learnable JPEG color and quantization transform that enables increased accuracy for global, dense, and vision-language-based perception. Using SEAOTTER, we train both general-purpose and task-aware transcoding pipelines for a pre-trained, frozen encoder. At a compression ratio of 200:1 and compared to AVIF, we observe 7 times faster encoding, 3.5 times faster decoding, and +8% ImageNet top-1 accuracy, while retaining compatibility with JPEG infrastructure. Our code is available at https://github.com/UT-SysML/seaotter .

Related papers

• PIC: Revisiting INR for Image Coding with Fast Encoding and Sub-Millisecond Decoding [74.2282307661978]
  Implicit neural representation (INR) has achieved remarkable progress in novel view synthesis and image/video coding in recent years.<n>In this work, we propose a feedforward INR image coding architecture, Practical INR Image Codec (PIC), that computes all the necessary information for INR network in a single forward pass.
  arXiv  Detail & Related papers  (2026-09-08T16:52:00Z)
• ProGIC: Progressive and Lightweight Generative Image Compression with Residual Vector Quantization [59.481950697968706]
  We propose Progressive Generative Image Compression (ProGIC), a compact built on residual vector quantization (RVQ)<n>In RVQ, a sequence of vector quantizers encodes the residuals stage by stage, each with its own codebook.<n>We pair this with a lightweight backbone based on depthwise-separable convolutions and small attention blocks, enabling practical deployment on both GPU and CPU-only devices.
  arXiv  Detail & Related papers  (2026-03-03T11:47:05Z)
• JPEG-Inspired Cloud-Edge Holography [26.266559585726057]
  Computer-generated holography (CGH) presents a transformative solution for near-eye displays in augmented and virtual reality.<n>Recent advances in deep learning have greatly improved CGH in reconstructed quality and computational efficiency.<n>Our framework enables low-latency, bandwidth-efficient hologram streaming on resource-constrained wearable devices.
  arXiv  Detail & Related papers  (2025-12-13T15:49:41Z)
• Ultra-Low Bitrate Perceptual Image Compression with Shallow Encoder [41.0853762937392]
  We propose a novel Asymmetric Extreme Image Compression (AEIC) framework that pursues simultaneously encoding simplicity and decoding quality.<n>AEIC employs moderate or even shallow encoder networks, while leveraging an one-step diffusion decoder to maintain high-fidelity and high-realism.<n>Experiments demonstrate that AEIC not only outperforms existing methods on rate-distortion-perception performance at ultra-lows, but also delivers exceptional encoding efficiency for 35.8 FPS on 1080P input images.
  arXiv  Detail & Related papers  (2025-12-13T07:59:48Z)
• SIEDD: Shared-Implicit Encoder with Discrete Decoders [36.705337163276255]
  Implicit Neural Representations (INRs) offer exceptional fidelity for video compression by learning per-video optimized functions.<n>Existing attempts to accelerate INR encoding often sacrifice reconstruction quality or crucial coordinate-level control.<n>We introduce SIEDD, a novel architecture that fundamentally accelerates INR encoding without these compromises.
  arXiv  Detail & Related papers  (2025-06-29T19:39:43Z)
• Improving the Diffusability of Autoencoders [54.920783089085035]
  Latent diffusion models have emerged as the leading approach for generating high-quality images and videos.<n>We perform a spectral analysis of modern autoencoders and identify inordinate high-frequency components in their latent spaces.<n>We hypothesize that this high-frequency component interferes with the coarse-to-fine nature of the diffusion synthesis process and hinders the generation quality.
  arXiv  Detail & Related papers  (2025-02-20T18:45:44Z)
• MISC: Ultra-low Bitrate Image Semantic Compression Driven by Large Multimodal Model [78.4051835615796]
  This paper proposes a method called Multimodal Image Semantic Compression. It consists of an LMM encoder for extracting the semantic information of the image, a map encoder to locate the region corresponding to the semantic, an image encoder generates an extremely compressed bitstream, and a decoder reconstructs the image based on the above information. It can achieve optimal consistency and perception results while saving perceptual 50%, which has strong potential applications in the next generation of storage and communication.
  arXiv  Detail & Related papers  (2024-02-26T17:11:11Z)
• Pruned Lightweight Encoders for Computer Vision [0.0]
  We show that ASTC and JPEG XS encoding configurations can be used on a near-sensor edge device to ensure low latency. We reduced the classification accuracy and segmentation mean over union (mIoU) degradation due to ASTC compression to 4.9-5.0 percentage points (pp) and 4.4-4.0 pp, respectively. In terms of encoding speed, our ASTC encoder implementation is 2.3x faster than JPEG.
  arXiv  Detail & Related papers  (2022-11-23T17:11:48Z)
• Neural JPEG: End-to-End Image Compression Leveraging a Standard JPEG Encoder-Decoder [73.48927855855219]
  We propose a system that learns to improve the encoding performance by enhancing its internal neural representations on both the encoder and decoder ends. Experiments demonstrate that our approach successfully improves the rate-distortion performance over JPEG across various quality metrics.
  arXiv  Detail & Related papers  (2022-01-27T20:20:03Z)
• Learning to Improve Image Compression without Changing the Standard Decoder [100.32492297717056]
  We propose learning to improve the encoding performance with the standard decoder. Specifically, a frequency-domain pre-editing method is proposed to optimize the distribution of DCT coefficients. We do not modify the JPEG decoder and therefore our approach is applicable when viewing images with the widely used standard JPEG decoder.
  arXiv  Detail & Related papers  (2020-09-27T19:24:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.