INRetouch: Context Aware Implicit Neural Representation for Photography Retouching

• URL: http://arxiv.org/abs/2412.03848v2
• Date: Wed, 11 Dec 2024 16:26:09 GMT
• Title: INRetouch: Context Aware Implicit Neural Representation for Photography Retouching
• Authors: Omar Elezabi, Marcos V. Conde, Zongwei Wu, Radu Timofte,
• Abstract summary: We propose a novel retouch transfer approach that learns from professional edits through before-after image pairs. We develop a context-aware Implicit Neural Representation that learns to apply edits adaptively based on image content and context. Our approach not only surpasses existing methods in photo retouching but also enhances performance in related image reconstruction tasks.
• Score: 54.17599183365242
• License:
• Abstract: Professional photo editing remains challenging, requiring extensive knowledge of imaging pipelines and significant expertise. With the ubiquity of smartphone photography, there is an increasing demand for accessible yet sophisticated image editing solutions. While recent deep learning approaches, particularly style transfer methods, have attempted to automate this process, they often struggle with output fidelity, editing control, and complex retouching capabilities. We propose a novel retouch transfer approach that learns from professional edits through before-after image pairs, enabling precise replication of complex editing operations. To facilitate this research direction, we introduce a comprehensive Photo Retouching Dataset comprising 100,000 high-quality images edited using over 170 professional Adobe Lightroom presets. We develop a context-aware Implicit Neural Representation that learns to apply edits adaptively based on image content and context, requiring no pretraining and capable of learning from a single example. Our method extracts implicit transformations from reference edits and adaptively applies them to new images. Through extensive evaluation, we demonstrate that our approach not only surpasses existing methods in photo retouching but also enhances performance in related image reconstruction tasks like Gamut Mapping and Raw Reconstruction. By bridging the gap between professional editing capabilities and automated solutions, our work presents a significant step toward making sophisticated photo editing more accessible while maintaining high-fidelity results. Check the Project Page at https://omaralezaby.github.io/inretouch for more Results and information about Code and Dataset availability.

Related papers

• PromptArtisan: Multi-instruction Image Editing in Single Pass with Complete Attention Control [1.0079049259808768]
  PromptArtisan is a groundbreaking approach to multi-instruction image editing. It achieves remarkable results in a single pass, eliminating the need for time-consuming iterative refinement.
  arXiv  Detail & Related papers  (2025-02-14T16:11:57Z)
• Lost in Edits? A $λ$-Compass for AIGC Provenance [119.95562081325552]
  We propose a novel latent-space attribution method that robustly identifies and differentiates authentic outputs from manipulated ones. LambdaTracer is effective across diverse iterative editing processes, whether automated through text-guided editing tools such as InstructPix2Pix or performed manually with editing software such as Adobe Photoshop.
  arXiv  Detail & Related papers  (2025-02-05T06:24:25Z)
• Streamlining Image Editing with Layered Diffusion Brushes [8.738398948669609]
  Our system renders a single edit on a 512x512 image within 140 ms using a high-end consumer GPU. Our approach demonstrates efficacy across a range of tasks, including object attribute adjustments, error correction, and sequential prompt-based object placement and manipulation.
  arXiv  Detail & Related papers  (2024-05-01T04:30:03Z)
• InstructBrush: Learning Attention-based Instruction Optimization for Image Editing [54.07526261513434]
  InstructBrush is an inversion method for instruction-based image editing methods. It extracts editing effects from image pairs as editing instructions, which are further applied for image editing. Our approach achieves superior performance in editing and is more semantically consistent with the target editing effects.
  arXiv  Detail & Related papers  (2024-03-27T15:03:38Z)
• InstructGIE: Towards Generalizable Image Editing [34.83188723673297]
  We introduce a novel image editing framework with enhanced generalization robustness. This framework incorporates a module specifically optimized for image editing tasks, leveraging the VMamba Block. We also unveil a selective area-matching technique specifically engineered to address and rectify corrupted details in generated images.
  arXiv  Detail & Related papers  (2024-03-08T03:43:04Z)
• Optimisation-Based Multi-Modal Semantic Image Editing [58.496064583110694]
  We propose an inference-time editing optimisation to accommodate multiple editing instruction types. By allowing to adjust the influence of each loss function, we build a flexible editing solution that can be adjusted to user preferences. We evaluate our method using text, pose and scribble edit conditions, and highlight our ability to achieve complex edits.
  arXiv  Detail & Related papers  (2023-11-28T15:31:11Z)
• Emu Edit: Precise Image Editing via Recognition and Generation Tasks [62.95717180730946]
  We present Emu Edit, a multi-task image editing model which sets state-of-the-art results in instruction-based image editing. We train it to multi-task across an unprecedented range of tasks, such as region-based editing, free-form editing, and Computer Vision tasks. We show that Emu Edit can generalize to new tasks, such as image inpainting, super-resolution, and compositions of editing tasks, with just a few labeled examples.
  arXiv  Detail & Related papers  (2023-11-16T18:55:58Z)
• One-shot Detail Retouching with Patch Space Neural Transformation Blending [0.0]
  We introduce a one-shot learning based technique to automatically retouch details of an input image based on just a single pair of before and after example images. Our approach provides accurate and general detail edit transfer to new images.
  arXiv  Detail & Related papers  (2022-10-03T20:24:36Z)
• SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editing [94.31103255204933]
  We propose a unified model for open-domain image editing focusing on color and tone adjustment of open-domain images. Our model learns a unified editing space that is more semantic, intuitive, and easy to manipulate. We show that by inverting image pairs into latent codes of the learned editing space, our model can be leveraged for various downstream editing tasks.
  arXiv  Detail & Related papers  (2021-11-30T23:53:32Z)
• A Generative Adversarial Approach with Residual Learning for Dust and Scratches Artifacts Removal [0.0]
  We present a GAN based method that is able to remove dust and scratches errors from film scans. residual learning is utilized to speed up the training process, as well as boost the denoising performance. We significantly outperform the state-of-the-art methods and software applications, providing superior results.
  arXiv  Detail & Related papers  (2020-09-22T16:32:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.