Controllable and Gradual Facial Blemishes Retouching via Physics-Based Modelling

• URL: http://arxiv.org/abs/2406.13227v1
• Date: Wed, 19 Jun 2024 05:28:52 GMT
• Title: Controllable and Gradual Facial Blemishes Retouching via Physics-Based Modelling
• Authors: Chenhao Shuai, Rizhao Cai, Bandara Dissanayake, Amanda Newman, Dayan Guan, Dennis Sng, Ling Li, Alex Kot,
• Abstract summary: Controllable and Gradual Face Retouching (CGFR) Our CGFR is based on physical modelling, adopting Sum-of-Gaussians to approximate skin subsurface scattering in a melanin and haemoglobin color space. Experimental results based on actual clinical data shows that CGFR can realistically simulate the blemishes' gradual recovering process.
• Score: 13.692701572821262
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Face retouching aims to remove facial blemishes, such as pigmentation and acne, and still retain fine-grain texture details. Nevertheless, existing methods just remove the blemishes but focus little on realism of the intermediate process, limiting their use more to beautifying facial images on social media rather than being effective tools for simulating changes in facial pigmentation and ance. Motivated by this limitation, we propose our Controllable and Gradual Face Retouching (CGFR). Our CGFR is based on physical modelling, adopting Sum-of-Gaussians to approximate skin subsurface scattering in a decomposed melanin and haemoglobin color space. Our CGFR offers a user-friendly control over the facial blemishes, achieving realistic and gradual blemishes retouching. Experimental results based on actual clinical data shows that CGFR can realistically simulate the blemishes' gradual recovering process.

Related papers

• Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models [69.50286698375386]
  We propose a novel approach that better harnesses diffusion models for face-swapping. We introduce a mask shuffling technique during inpainting training, which allows us to create a so-called universal model for swapping. Ours is a relatively unified approach and so it is resilient to errors in other off-the-shelf models.
  arXiv  Detail & Related papers  (2024-09-11T13:43:53Z)
• A Generalist FaceX via Learning Unified Facial Representation [77.74407008931486]
  FaceX is a novel facial generalist model capable of handling diverse facial tasks simultaneously. Our versatile FaceX achieves competitive performance compared to elaborate task-specific models on popular facial editing tasks.
  arXiv  Detail & Related papers  (2023-12-31T17:41:48Z)
• Evaluating the Efficacy of Skincare Product: A Realistic Short-Term Facial Pore Simulation [68.06388750609058]
  We propose the first simulation model to reveal facial pore changes after using skincare products. The proposed simulation is able to render realistic facial pore changes.
  arXiv  Detail & Related papers  (2023-02-23T12:00:15Z)
• Enhancing Quality of Pose-varied Face Restoration with Local Weak Feature Sensing and GAN Prior [29.17397958948725]
  We propose a well-designed blind face restoration network with generative facial prior. Our model performs superior to the prior art for face restoration and face super-resolution tasks.
  arXiv  Detail & Related papers  (2022-05-28T09:23:48Z)
• Total Scale: Face-to-Body Detail Reconstruction from Sparse RGBD Sensors [52.38220261632204]
  Flat facial surfaces frequently occur in the PIFu-based reconstruction results. We propose a two-scale PIFu representation to enhance the quality of the reconstructed facial details. Experiments demonstrate the effectiveness of our approach in vivid facial details and deforming body shapes.
  arXiv  Detail & Related papers  (2021-12-03T18:46:49Z)
• MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation [69.35523133292389]
  We propose a framework that a priori models physical attributes of the face explicitly, thus providing disentanglement by design. Our method, MOST-GAN, integrates the expressive power and photorealism of style-based GANs with the physical disentanglement and flexibility of nonlinear 3D morphable models. It achieves photorealistic manipulation of portrait images with fully disentangled 3D control over their physical attributes, enabling extreme manipulation of lighting, facial expression, and pose variations up to full profile view.
  arXiv  Detail & Related papers  (2021-11-01T15:53:36Z)
• Guided Facial Skin Color Correction [21.70829294686434]
  In portrait photographs, skin color is often distorted due to the lighting environment. In our framework, we perform color and brightness correction around the face in the original image to achieve a proper color balance. Unlike conventional algorithms for color correction, our final result is attained by a color correction process with a guide image.
  arXiv  Detail & Related papers  (2021-05-19T09:59:55Z)
• Towards Real-World Blind Face Restoration with Generative Facial Prior [19.080349401153097]
  Blind face restoration usually relies on facial priors, such as facial geometry prior or reference prior, to restore realistic and faithful details. We propose GFP-GAN that leverages rich and diverse priors encapsulated in a pretrained face GAN for blind face restoration. Our method achieves superior performance to prior art on both synthetic and real-world datasets.
  arXiv  Detail & Related papers  (2021-01-11T17:54:38Z)
• Leveraging Adaptive Color Augmentation in Convolutional Neural Networks for Deep Skin Lesion Segmentation [0.0]
  We propose an adaptive color augmentation technique to amplify data expression and model performance. We qualitatively identify and verify the semantic structural features learned by the network for discriminating skin lesions against normal skin tissue.
  arXiv  Detail & Related papers  (2020-10-31T00:16:23Z)
• Unsupervised Learning Facial Parameter Regressor for Action Unit Intensity Estimation via Differentiable Renderer [51.926868759681014]
  We present a framework to predict the facial parameters based on a bone-driven face model (BDFM) under different views. The proposed framework consists of a feature extractor, a generator, and a facial parameter regressor.
  arXiv  Detail & Related papers  (2020-08-20T09:49:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.