Efficient High-Resolution Image Editing with Hallucination-Aware Loss and Adaptive Tiling

• URL: http://arxiv.org/abs/2510.06295v1
• Date: Tue, 07 Oct 2025 12:09:24 GMT
• Title: Efficient High-Resolution Image Editing with Hallucination-Aware Loss and Adaptive Tiling
• Abstract summary: MobilePicasso is a novel system that enables efficient image editing at high resolutions, while minimising computational cost and memory usage.<n>Our user study with 46 participants reveals that MobilePicasso not only improves image quality by 18-48% but reduces hallucinations by 14-51% over existing methods.<n>Surprisingly, the on-device runtime of MobilePicasso is observed to be faster than a server-based high-resolution image editing model running on an A100 GPU.
• Score: 6.389384409681223
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: High-resolution (4K) image-to-image synthesis has become increasingly important for mobile applications. Existing diffusion models for image editing face significant challenges, in terms of memory and image quality, when deployed on resource-constrained devices. In this paper, we present MobilePicasso, a novel system that enables efficient image editing at high resolutions, while minimising computational cost and memory usage. MobilePicasso comprises three stages: (i) performing image editing at a standard resolution with hallucination-aware loss, (ii) applying latent projection to overcome going to the pixel space, and (iii) upscaling the edited image latent to a higher resolution with adaptive context-preserving tiling. Our user study with 46 participants reveals that MobilePicasso not only improves image quality by 18-48% but reduces hallucinations by 14-51% over existing methods. MobilePicasso demonstrates significantly lower latency, e.g., up to 55.8$\times$ speed-up, yet with a small increase in runtime memory, e.g., a mere 9% increase over prior work. Surprisingly, the on-device runtime of MobilePicasso is observed to be faster than a server-based high-resolution image editing model running on an A100 GPU.

Related papers

• CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation [17.654969014220033]
  CineMobile generates 49-frame 480p videos with a per-step denoising latency of 0.6s on an NVIDIA H200 GPU and 20s on the MediaTek Dimensity 8400 Ultimate 5G platform.<n>CineMobile achieves a 40x speedup in generation while maintaining comparable visual quality.
  arXiv  Detail & Related papers  (2026-07-04T10:24:35Z)
• MobileMEF: Fast and Efficient Method for Multi-Exposure Fusion [0.6261722394141346]
  We propose a new method for multi-exposure fusion based on an encoder-decoder deep learning architecture. Our model is capable of processing 4K resolution images in less than 2 seconds on mid-range smartphones.
  arXiv  Detail & Related papers  (2024-08-15T05:03:14Z)
• Real-Time Under-Display Cameras Image Restoration and HDR on Mobile Devices [81.61356052916855]
  The images captured by under-display cameras (UDCs) are degraded by the screen in front of them. Deep learning methods for image restoration can significantly reduce the degradation of captured images. We propose a lightweight model for blind UDC Image Restoration and HDR, and we also provide a benchmark comparing the performance and runtime of different methods on smartphones.
  arXiv  Detail & Related papers  (2022-11-25T11:46:57Z)
• MicroISP: Processing 32MP Photos on Mobile Devices with Deep Learning [114.66037224769005]
  We present a novel MicroISP model designed specifically for edge devices. The proposed solution is capable of processing up to 32MP photos on recent smartphones using the standard mobile ML libraries. The architecture of the model is flexible, allowing to adjust its complexity to devices of different computational power.
  arXiv  Detail & Related papers  (2022-11-08T17:40:50Z)
• Perceptual Image Enhancement for Smartphone Real-Time Applications [60.45737626529091]
  We propose LPIENet, a lightweight network for perceptual image enhancement. Our model can deal with noise artifacts, diffraction artifacts, blur, and HDR overexposure. Our model can process 2K resolution images under 1 second in mid-level commercial smartphones.
  arXiv  Detail & Related papers  (2022-10-24T19:16:33Z)
• Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireing [71.62289021118983]
  We present an efficient baseline model ESDNet for tackling 4K moire images, wherein we build a semantic-aligned scale-aware module to address the scale variation of moire patterns. Our approach outperforms state-of-the-art methods by a large margin while being much more lightweight.
  arXiv  Detail & Related papers  (2022-07-20T14:20:52Z)
• Real-Time Quantized Image Super-Resolution on Mobile NPUs, Mobile AI 2021 Challenge: Report [67.86837649834636]
  We introduce the first Mobile AI challenge, where the target is to develop an end-to-end deep learning-based image super-resolution solution. The proposed solutions are fully compatible with all major mobile AI accelerators and are capable of reconstructing Full HD images under 40-60 ms.
  arXiv  Detail & Related papers  (2021-05-17T13:34:15Z)
• Fast Camera Image Denoising on Mobile GPUs with Deep Learning, Mobile AI 2021 Challenge: Report [64.09439666916465]
  We introduce the first Mobile AI challenge, where the target is to develop an end-to-end deep learning-based image denoising solution. The proposed solutions are fully compatible with any mobile GPU and are capable of processing 480p resolution images under 40-80 ms.
  arXiv  Detail & Related papers  (2021-05-17T13:27:56Z)
• Contextual Residual Aggregation for Ultra High-Resolution Image Inpainting [12.839962012888199]
  We propose a Contextual Residual Aggregation (CRA) mechanism that can produce high-frequency residuals for missing contents. CRA mechanism produces high-frequency residuals for missing contents by weighted aggregating residuals from contextual patches. We train the proposed model on small images with resolutions 512x512 and perform inference on high-resolution images, achieving compelling inpainting quality.
  arXiv  Detail & Related papers  (2020-05-19T18:55:32Z)
• Deploying Image Deblurring across Mobile Devices: A Perspective of Quality and Latency [11.572636762286775]
  We conduct a search of portable network architectures for better quality-blur trade-off across mobile devices. This paper provides comprehensive experiments and comparisons to uncover the in-depth analysis for both latency and image quality. To the best of our knowledge, this is the first paper that addresses all the deployment issues of image deblurring task across mobile devices.
  arXiv  Detail & Related papers  (2020-04-27T06:32:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.