Pitfalls of defacing whole-head MRI: re-identification risk with diffusion models and compromised research potential
- URL: http://arxiv.org/abs/2501.18834v1
- Date: Fri, 31 Jan 2025 00:58:12 GMT
- Title: Pitfalls of defacing whole-head MRI: re-identification risk with diffusion models and compromised research potential
- Authors: Chenyu Gao, Kaiwen Xu, Michael E. Kim, Lianrui Zuo, Zhiyuan Li, Derek B. Archer, Timothy J. Hohman, Ann Zenobia Moore, Luigi Ferrucci, Lori L. Beason-Held, Susan M. Resnick, Christos Davatzikos, Jerry L. Prince, Bennett A. Landman,
- Abstract summary: We develop a refacing pipeline that recovers faces in defaced head MRIs using cascaded probabilistic diffusion models (DPMs)
The DPMs are trained on images from 180 subjects and tested on images from 484 unseen subjects, 469 of whom are from a different dataset.
Results show that DPMs can generate high-fidelity faces that resemble the original faces from defaced images, with surface distances to the original faces significantly smaller than those of a population average face.
- Score: 11.891539513675697
- License:
- Abstract: Defacing is often applied to head magnetic resonance image (MRI) datasets prior to public release to address privacy concerns. The alteration of facial and nearby voxels has provoked discussions about the true capability of these techniques to ensure privacy as well as their impact on downstream tasks. With advancements in deep generative models, the extent to which defacing can protect privacy is uncertain. Additionally, while the altered voxels are known to contain valuable anatomical information, their potential to support research beyond the anatomical regions directly affected by defacing remains uncertain. To evaluate these considerations, we develop a refacing pipeline that recovers faces in defaced head MRIs using cascaded diffusion probabilistic models (DPMs). The DPMs are trained on images from 180 subjects and tested on images from 484 unseen subjects, 469 of whom are from a different dataset. To assess whether the altered voxels in defacing contain universally useful information, we also predict computed tomography (CT)-derived skeletal muscle radiodensity from facial voxels in both defaced and original MRIs. The results show that DPMs can generate high-fidelity faces that resemble the original faces from defaced images, with surface distances to the original faces significantly smaller than those of a population average face (p < 0.05). This performance also generalizes well to previously unseen datasets. For skeletal muscle radiodensity predictions, using defaced images results in significantly weaker Spearman's rank correlation coefficients compared to using original images (p < 10-4). For shin muscle, the correlation is statistically significant (p < 0.05) when using original images but not statistically significant (p > 0.05) when any defacing method is applied, suggesting that defacing might not only fail to protect privacy but also eliminate valuable information.
Related papers
- OpticalDR: A Deep Optical Imaging Model for Privacy-Protective
Depression Recognition [66.91236298878383]
Depression Recognition (DR) poses a considerable challenge, especially in the context of privacy concerns.
We design a new imaging system to erase the identity information of captured facial images while retain disease-relevant features.
It is irreversible for identity information recovery while preserving essential disease-related characteristics necessary for accurate DR.
arXiv Detail & Related papers (2024-02-29T01:20:29Z) - Privacy Protection in MRI Scans Using 3D Masked Autoencoders [2.463789441707266]
Data anonymization and de-identification is concerned with ensuring the privacy and confidentiality of individuals' personal information.
We propose CP-MAE, a model that de-identifies the face by remodeling it.
With our method we are able to synthesize high-fidelity scans of resolution up to $2563$ -- compared to $1283$ with previous approaches.
arXiv Detail & Related papers (2023-10-24T12:25:37Z) - Privacy Assessment on Reconstructed Images: Are Existing Evaluation
Metrics Faithful to Human Perception? [86.58989831070426]
We study the faithfulness of hand-crafted metrics to human perception of privacy information from reconstructed images.
We propose a learning-based measure called SemSim to evaluate the Semantic Similarity between the original and reconstructed images.
arXiv Detail & Related papers (2023-09-22T17:58:04Z) - Fast refacing of MR images with a generative neural network lowers
re-identification risk and preserves volumetric consistency [5.040145546652933]
We propose a novel method for anonymised face generation for 3D T1-weighted scans based on a 3D conditional generative adversarial network.
The proposed method takes 9 seconds for face generation and is suitable for recovering consistent post-processing results after defacing.
arXiv Detail & Related papers (2023-05-26T13:34:14Z) - Estimating Head Motion from MR-Images [0.0]
Head motion is an omnipresent confounder of magnetic resonance image (MRI) analyses.
We introduce a deep learning method to predict in-scanner head motion directly from T1-weighted (T1w), T2-weighted (T2w) and fluid-attenuated inversion recovery (FLAIR) images.
arXiv Detail & Related papers (2023-02-28T11:03:08Z) - Automated SSIM Regression for Detection and Quantification of Motion
Artefacts in Brain MR Images [54.739076152240024]
Motion artefacts in magnetic resonance brain images are a crucial issue.
The assessment of MR image quality is fundamental before proceeding with the clinical diagnosis.
An automated image quality assessment based on the structural similarity index (SSIM) regression has been proposed here.
arXiv Detail & Related papers (2022-06-14T10:16:54Z) - Negligible effect of brain MRI data preprocessing for tumor segmentation [36.89606202543839]
We conduct experiments on three publicly available datasets and evaluate the effect of different preprocessing steps in deep neural networks.
Our results demonstrate that most popular standardization steps add no value to the network performance.
We suggest that image intensity normalization approaches do not contribute to model accuracy because of the reduction of signal variance with image standardization.
arXiv Detail & Related papers (2022-04-11T17:29:36Z) - End2End Occluded Face Recognition by Masking Corrupted Features [82.27588990277192]
State-of-the-art general face recognition models do not generalize well to occluded face images.
This paper presents a novel face recognition method that is robust to occlusions based on a single end-to-end deep neural network.
Our approach, named FROM (Face Recognition with Occlusion Masks), learns to discover the corrupted features from the deep convolutional neural networks, and clean them by the dynamically learned masks.
arXiv Detail & Related papers (2021-08-21T09:08:41Z) - Re-identification of Individuals in Genomic Datasets Using Public Face
Images [30.331049734571746]
We study how successful such linkage attacks can be when real face images are used.
We observe that the true risk of re-identification is likely substantially smaller for most individuals than prior literature suggests.
arXiv Detail & Related papers (2021-02-17T03:54:25Z) - Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction.
Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
arXiv Detail & Related papers (2020-10-05T14:18:52Z) - Understanding the robustness of deep neural network classifiers for
breast cancer screening [52.50078591615855]
Deep neural networks (DNNs) show promise in breast cancer screening, but their robustness to input perturbations must be better understood before they can be clinically implemented.
We measure the sensitivity of a radiologist-level screening mammogram image classifier to four commonly studied input perturbations.
We also perform a detailed analysis on the effects of low-pass filtering, and find that it degrades the visibility of clinically meaningful features.
arXiv Detail & Related papers (2020-03-23T01:26:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.