The Fairness Stitch: Unveiling the Potential of Model Stitching in
Neural Network De-Biasing
- URL: http://arxiv.org/abs/2311.03532v1
- Date: Mon, 6 Nov 2023 21:14:37 GMT
- Title: The Fairness Stitch: Unveiling the Potential of Model Stitching in
Neural Network De-Biasing
- Authors: Modar Sulaiman and Kallol Roy
- Abstract summary: This study introduces a novel method called "The Fairness Stitch" to enhance fairness in deep learning models.
We conduct a comprehensive evaluation of two well-known datasets, CelebA and UTKFace.
Our findings reveal a notable improvement in achieving a balanced trade-off between fairness and performance.
- Score: 0.043512163406552
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The pursuit of fairness in machine learning models has emerged as a critical
research challenge in different applications ranging from bank loan approval to
face detection. Despite the widespread adoption of artificial intelligence
algorithms across various domains, concerns persist regarding the presence of
biases and discrimination within these models. To address this pressing issue,
this study introduces a novel method called "The Fairness Stitch (TFS)" to
enhance fairness in deep learning models. This method combines model stitching
and training jointly, while incorporating fairness constraints. In this
research, we assess the effectiveness of our proposed method by conducting a
comprehensive evaluation of two well-known datasets, CelebA and UTKFace. We
systematically compare the performance of our approach with the existing
baseline method. Our findings reveal a notable improvement in achieving a
balanced trade-off between fairness and performance, highlighting the promising
potential of our method to address bias-related challenges and foster equitable
outcomes in machine learning models. This paper poses a challenge to the
conventional wisdom of the effectiveness of the last layer in deep learning
models for de-biasing.
Related papers
- Self-Improving Interference Management Based on Deep Learning With
Uncertainty Quantification [10.403513606082067]
This paper presents a self-improving interference management framework tailored for wireless communications.
Our approach addresses the computational challenges inherent in traditional optimization-based algorithms.
A breakthrough of our framework is its acknowledgment of the limitations inherent in data-driven models.
arXiv Detail & Related papers (2024-01-24T03:28:48Z) - Learning Objective-Specific Active Learning Strategies with Attentive
Neural Processes [72.75421975804132]
Learning Active Learning (LAL) suggests to learn the active learning strategy itself, allowing it to adapt to the given setting.
We propose a novel LAL method for classification that exploits symmetry and independence properties of the active learning problem.
Our approach is based on learning from a myopic oracle, which gives our model the ability to adapt to non-standard objectives.
arXiv Detail & Related papers (2023-09-11T14:16:37Z) - Should We Attend More or Less? Modulating Attention for Fairness [11.249410336982258]
We study the role of attention, a widely-used technique in current state-of-the-art NLP models, in the propagation of social biases.
We propose a novel method for modulating attention weights to improve model fairness after training.
Our results show an increase in fairness and minimal performance loss on different text classification and generation tasks.
arXiv Detail & Related papers (2023-05-22T14:54:21Z) - Stochastic Methods for AUC Optimization subject to AUC-based Fairness
Constraints [51.12047280149546]
A direct approach for obtaining a fair predictive model is to train the model through optimizing its prediction performance subject to fairness constraints.
We formulate the training problem of a fairness-aware machine learning model as an AUC optimization problem subject to a class of AUC-based fairness constraints.
We demonstrate the effectiveness of our approach on real-world data under different fairness metrics.
arXiv Detail & Related papers (2022-12-23T22:29:08Z) - Fairness Increases Adversarial Vulnerability [50.90773979394264]
This paper shows the existence of a dichotomy between fairness and robustness, and analyzes when achieving fairness decreases the model robustness to adversarial samples.
Experiments on non-linear models and different architectures validate the theoretical findings in multiple vision domains.
The paper proposes a simple, yet effective, solution to construct models achieving good tradeoffs between fairness and robustness.
arXiv Detail & Related papers (2022-11-21T19:55:35Z) - Learning Diversified Feature Representations for Facial Expression
Recognition in the Wild [97.14064057840089]
We propose a mechanism to diversify the features extracted by CNN layers of state-of-the-art facial expression recognition architectures.
Experimental results on three well-known facial expression recognition in-the-wild datasets, AffectNet, FER+, and RAF-DB, show the effectiveness of our method.
arXiv Detail & Related papers (2022-10-17T19:25:28Z) - Improving Sample Efficiency of Deep Learning Models in Electricity
Market [0.41998444721319217]
We propose a general framework, namely Knowledge-Augmented Training (KAT), to improve the sample efficiency.
We propose a novel data augmentation technique to generate some synthetic data, which are later processed by an improved training strategy.
Modern learning theories demonstrate the effectiveness of our method in terms of effective prediction error feedbacks, a reliable loss function, and rich gradient noises.
arXiv Detail & Related papers (2022-10-11T16:35:13Z) - Learnability of Competitive Threshold Models [11.005966612053262]
We study the learnability of the competitive threshold model from a theoretical perspective.
We demonstrate how competitive threshold models can be seamlessly simulated by artificial neural networks.
arXiv Detail & Related papers (2022-05-08T01:11:51Z) - On Modality Bias Recognition and Reduction [70.69194431713825]
We study the modality bias problem in the context of multi-modal classification.
We propose a plug-and-play loss function method, whereby the feature space for each label is adaptively learned.
Our method yields remarkable performance improvements compared with the baselines.
arXiv Detail & Related papers (2022-02-25T13:47:09Z) - Modeling Techniques for Machine Learning Fairness: A Survey [17.925809181329015]
In recent years, various techniques have been developed to mitigate the bias for machine learning models.
In this survey, we review the current progress of in-processing bias mitigation techniques.
arXiv Detail & Related papers (2021-11-04T17:17:26Z) - Accurate and Robust Feature Importance Estimation under Distribution
Shifts [49.58991359544005]
PRoFILE is a novel feature importance estimation method.
We show significant improvements over state-of-the-art approaches, both in terms of fidelity and robustness.
arXiv Detail & Related papers (2020-09-30T05:29:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.