Automatic Quantification of Facial Asymmetry using Facial Landmarks
- URL: http://arxiv.org/abs/2103.11059v1
- Date: Sat, 20 Mar 2021 00:08:37 GMT
- Title: Automatic Quantification of Facial Asymmetry using Facial Landmarks
- Authors: Abu Md Niamul Taufique, Andreas Savakis, Jonathan Leckenby
- Abstract summary: One-sided facial paralysis causes uneven movements of facial muscles on the sides of the face.
This paper proposes a novel method to provide an objective and quantitative asymmetry score for frontal faces.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: One-sided facial paralysis causes uneven movements of facial muscles on the
sides of the face. Physicians currently assess facial asymmetry in a subjective
manner based on their clinical experience. This paper proposes a novel method
to provide an objective and quantitative asymmetry score for frontal faces. Our
metric has the potential to help physicians for diagnosis as well as monitoring
the rehabilitation of patients with one-sided facial paralysis. A deep learning
based landmark detection technique is used to estimate style invariant facial
landmark points and dense optical flow is used to generate motion maps from a
short sequence of frames. Six face regions are considered corresponding to the
left and right parts of the forehead, eyes, and mouth. Motion is computed and
compared between the left and the right parts of each region of interest to
estimate the symmetry score. For testing, asymmetric sequences are
synthetically generated from a facial expression dataset. A score equation is
developed to quantify symmetry in both symmetric and asymmetric face sequences.
Related papers
- Combining Generative and Geometry Priors for Wide-Angle Portrait Correction [54.448014761978975]
We propose encapsulating the generative face prior as a guided natural manifold to facilitate the correction of facial regions.
A notable central symmetry relationship exists in the non-face background, yet it has not been explored in the correction process.
This geometry prior motivates us to introduce a novel constraint to explicitly enforce symmetry throughout the correction process.
arXiv Detail & Related papers (2024-10-13T16:36:52Z) - SymFace: Additional Facial Symmetry Loss for Deep Face Recognition [1.5612101323427952]
This research examines the natural phenomenon of facial symmetry in the face verification problem.
We show that the two output embedding vectors of split faces must project close to each other in the output embedding space.
Inspired by this concept, we penalize the network based on the disparity of embedding of the symmetrical pair of split faces.
arXiv Detail & Related papers (2024-09-18T09:06:55Z) - Periocular biometrics: databases, algorithms and directions [69.35569554213679]
Periocular biometrics has been established as an independent modality due to concerns on the performance of iris or face systems in uncontrolled conditions.
This paper presents a review of the state of the art in periocular biometric research.
arXiv Detail & Related papers (2023-07-26T11:14:36Z) - SFI-Swin: Symmetric Face Inpainting with Swin Transformer by Distinctly
Learning Face Components Distributions [11.031841470875571]
Inpainting face images with symmetric characteristics is more challenging than inpainting a natural scene.
We propose "symmetry concentration score" as a new metric for measuring the symmetry of a repaired face image.
arXiv Detail & Related papers (2023-01-09T00:56:51Z) - Symmetry-Enhanced Attention Network for Acute Ischemic Infarct
Segmentation with Non-Contrast CT Images [50.55978219682419]
We propose a symmetry enhanced attention network (SEAN) for acute ischemic infarct segmentation.
Our proposed network automatically transforms an input CT image into the standard space where the brain tissue is bilaterally symmetric.
The proposed SEAN outperforms some symmetry-based state-of-the-art methods in terms of both dice coefficient and infarct localization.
arXiv Detail & Related papers (2021-10-11T07:13:26Z) - Pro-UIGAN: Progressive Face Hallucination from Occluded Thumbnails [53.080403912727604]
We propose a multi-stage Progressive Upsampling and Inpainting Generative Adversarial Network, dubbed Pro-UIGAN.
It exploits facial geometry priors to replenish and upsample (8*) the occluded and tiny faces.
Pro-UIGAN achieves visually pleasing HR faces, reaching superior performance in downstream tasks.
arXiv Detail & Related papers (2021-08-02T02:29:24Z) - Bilateral Asymmetry Guided Counterfactual Generating Network for
Mammogram Classification [48.4619620405991]
Mammogram benign or malignant classification with only image-level labels is challenging due to the absence of lesion annotations.
Motivated by the symmetric prior, we can explore a counterfactual problem that how would the features have behaved if there were no lesions in the image.
We derive a new theoretical result for counterfactual generation based on the symmetric prior.
arXiv Detail & Related papers (2020-09-30T03:15:30Z) - Unsupervised Learning Facial Parameter Regressor for Action Unit
Intensity Estimation via Differentiable Renderer [51.926868759681014]
We present a framework to predict the facial parameters based on a bone-driven face model (BDFM) under different views.
The proposed framework consists of a feature extractor, a generator, and a facial parameter regressor.
arXiv Detail & Related papers (2020-08-20T09:49:13Z) - Detection of Pitt-Hopkins Syndrome based on morphological facial
features [0.0]
This work describes an automatic methodology to discriminate between individuals with Pitt-Hopkins syndrome (PTHS) and healthy individuals.
The methodology was tested on 71 individuals with PTHS and 55 healthy controls.
arXiv Detail & Related papers (2020-03-18T14:01:16Z) - Exploring Partial Intrinsic and Extrinsic Symmetry in 3D Medical Imaging [39.5958976939981]
We present a novel methodology to detect imperfect bilateral symmetry in CT of human anatomy.
The structurally symmetric nature of the pelvic bone is explored and is used to provide interventional image augmentation for treatment of unilateral fractures in patients with traumatic injuries.
arXiv Detail & Related papers (2020-03-04T19:08:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.