SFI-Swin: Symmetric Face Inpainting with Swin Transformer by Distinctly Learning Face Components Distributions

• URL: http://arxiv.org/abs/2301.03130v1
• Date: Mon, 9 Jan 2023 00:56:51 GMT
• Title: SFI-Swin: Symmetric Face Inpainting with Swin Transformer by Distinctly Learning Face Components Distributions
• Authors: MohammadReza Naderi, MohammadHossein Givkashi, Nader Karimi, Shahram Shirani, Shadrokh Samavi
• Abstract summary: Inpainting face images with symmetric characteristics is more challenging than inpainting a natural scene. We propose "symmetry concentration score" as a new metric for measuring the symmetry of a repaired face image.
• Score: 11.031841470875571
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Image inpainting consists of filling holes or missing parts of an image. Inpainting face images with symmetric characteristics is more challenging than inpainting a natural scene. None of the powerful existing models can fill out the missing parts of an image while considering the symmetry and homogeneity of the picture. Moreover, the metrics that assess a repaired face image quality cannot measure the preservation of symmetry between the rebuilt and existing parts of a face. In this paper, we intend to solve the symmetry problem in the face inpainting task by using multiple discriminators that check each face organ's reality separately and a transformer-based network. We also propose "symmetry concentration score" as a new metric for measuring the symmetry of a repaired face image. The quantitative and qualitative results show the superiority of our proposed method compared to some of the recently proposed algorithms in terms of the reality, symmetry, and homogeneity of the inpainted parts.

Related papers

• Combining Generative and Geometry Priors for Wide-Angle Portrait Correction [54.448014761978975]
  We propose encapsulating the generative face prior as a guided natural manifold to facilitate the correction of facial regions. A notable central symmetry relationship exists in the non-face background, yet it has not been explored in the correction process. This geometry prior motivates us to introduce a novel constraint to explicitly enforce symmetry throughout the correction process.
  arXiv  Detail & Related papers  (2024-10-13T16:36:52Z)
• SymFace: Additional Facial Symmetry Loss for Deep Face Recognition [1.5612101323427952]
  This research examines the natural phenomenon of facial symmetry in the face verification problem. We show that the two output embedding vectors of split faces must project close to each other in the output embedding space. Inspired by this concept, we penalize the network based on the disparity of embedding of the symmetrical pair of split faces.
  arXiv  Detail & Related papers  (2024-09-18T09:06:55Z)
• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection [67.3143177137102]
  Deepfake detection refers to detecting artificially generated or edited faces in images or videos. We propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces.
  arXiv  Detail & Related papers  (2023-12-07T07:19:45Z)
• Degradation-agnostic Correspondence from Resolution-asymmetric Stereo [96.03964515969652]
  We study the problem of stereo matching from a pair of images with different resolutions, e.g., those acquired with a tele-wide camera system. We propose to impose the consistency between two views in a feature space instead of the image space, named feature-metric consistency. We find that, although a stereo matching network trained with the photometric loss is not optimal, its feature extractor can produce degradation-agnostic and matching-specific features.
  arXiv  Detail & Related papers  (2022-04-04T12:24:34Z)
• Human Face Recognition from Part of a Facial Image based on Image Stitching [0.0]
  Most of the current techniques for face recognition require the presence of a full face of the person to be recognized. In this work, we adopted the process of stitching the face by completing the missing part with the flipping of the part shown in the picture. The selected face recognition algorithms that are applied here are Eigenfaces and geometrical methods.
  arXiv  Detail & Related papers  (2022-03-10T19:31:57Z)
• Semi-parametric Makeup Transfer via Semantic-aware Correspondence [99.02329132102098]
  Large discrepancy between source non-makeup image and reference makeup image is one of key challenges in makeup transfer. Non-parametric techniques have a high potential for addressing the pose, expression, and occlusion discrepancies. We propose a textbfSemi-textbfparametric textbfMakeup textbfTransfer (SpMT) method, which combines the reciprocal strengths of non-parametric and parametric mechanisms.
  arXiv  Detail & Related papers  (2022-03-04T12:54:19Z)
• Non-Deterministic Face Mask Removal Based On 3D Priors [3.8502825594372703]
  The proposed approach integrates a multi-task 3D face reconstruction module with a face inpainting module. By gradually controlling the 3D shape parameters, our method generates high-quality dynamic inpainting results with different expressions and mouth movements.
  arXiv  Detail & Related papers  (2022-02-20T16:27:44Z)
• Automatic Quantification of Facial Asymmetry using Facial Landmarks [0.0]
  One-sided facial paralysis causes uneven movements of facial muscles on the sides of the face. This paper proposes a novel method to provide an objective and quantitative asymmetry score for frontal faces.
  arXiv  Detail & Related papers  (2021-03-20T00:08:37Z)
• Structured GANs [91.3755431537592]
  symmetric GANs are applied to face image synthesis in order to generate novel faces with a varying amount of symmetry. We also present an unsupervised face rotation capability, which is based on the novel notion of one-shot fine tuning.
  arXiv  Detail & Related papers  (2020-01-15T10:25:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.