PiRL: Participant-Invariant Representation Learning for Healthcare
- URL: http://arxiv.org/abs/2211.12422v1
- Date: Mon, 21 Nov 2022 18:16:49 GMT
- Title: PiRL: Participant-Invariant Representation Learning for Healthcare
- Authors: Zhaoyang Cao, Han Yu, Huiyuan Yang, Akane Sano
- Abstract summary: We propose a representation learning framework that learns participant-invariant representations, named PiRL.
As preliminary results, we found the proposed approach shows around a 5% increase in accuracy compared to the baseline.
- Score: 14.986449254864572
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Due to individual heterogeneity, performance gaps are observed between
generic (one-size-fits-all) models and person-specific models in data-driven
health applications. However, in real-world applications, generic models are
usually more favorable due to new-user-adaptation issues and system
complexities, etc. To improve the performance of the generic model, we propose
a representation learning framework that learns participant-invariant
representations, named PiRL. The proposed framework utilizes maximum mean
discrepancy (MMD) loss and domain-adversarial training to encourage the model
to learn participant-invariant representations. Further, a triplet loss, which
constrains the model for inter-class alignment of the representations, is
utilized to optimize the learned representations for downstream health
applications. We evaluated our frameworks on two public datasets related to
physical and mental health, for detecting sleep apnea and stress, respectively.
As preliminary results, we found the proposed approach shows around a 5%
increase in accuracy compared to the baseline.
Related papers
- Adaptive Affinity-Based Generalization For MRI Imaging Segmentation Across Resource-Limited Settings [1.5703963908242198]
This paper introduces a novel relation-based knowledge framework by seamlessly combining adaptive affinity-based and kernel-based distillation.
To validate our innovative approach, we conducted experiments on publicly available multi-source prostate MRI data.
arXiv Detail & Related papers (2024-04-03T13:35:51Z) - Secrets of RLHF in Large Language Models Part II: Reward Modeling [134.97964938009588]
We introduce a series of novel methods to mitigate the influence of incorrect and ambiguous preferences in the dataset.
We also introduce contrastive learning to enhance the ability of reward models to distinguish between chosen and rejected responses.
arXiv Detail & Related papers (2024-01-11T17:56:59Z) - GEC: A Unified Framework for Interactive Decision Making in MDP, POMDP,
and Beyond [101.5329678997916]
We study sample efficient reinforcement learning (RL) under the general framework of interactive decision making.
We propose a novel complexity measure, generalized eluder coefficient (GEC), which characterizes the fundamental tradeoff between exploration and exploitation.
We show that RL problems with low GEC form a remarkably rich class, which subsumes low Bellman eluder dimension problems, bilinear class, low witness rank problems, PO-bilinear class, and generalized regular PSR.
arXiv Detail & Related papers (2022-11-03T16:42:40Z) - Robust and Efficient Segmentation of Cross-domain Medical Images [37.38861543166964]
We propose a generalizable knowledge distillation method for robust and efficient segmentation of medical images.
We propose two generalizable knowledge distillation schemes, Dual Contrastive Graph Distillation (DCGD) and Domain-Invariant Cross Distillation (DICD)
In DICD, the domain-invariant semantic vectors from the two models (i.e., teacher and student) are leveraged to cross-reconstruct features by the header exchange of MSAN.
arXiv Detail & Related papers (2022-07-26T15:55:36Z) - HyperImpute: Generalized Iterative Imputation with Automatic Model
Selection [77.86861638371926]
We propose a generalized iterative imputation framework for adaptively and automatically configuring column-wise models.
We provide a concrete implementation with out-of-the-box learners, simulators, and interfaces.
arXiv Detail & Related papers (2022-06-15T19:10:35Z) - Interpretable Models Capable of Handling Systematic Missingness in
Imbalanced Classes and Heterogeneous Datasets [0.0]
Application of interpretable machine learning techniques on medical datasets facilitate early and fast diagnoses, along with getting deeper insight into the data.
Medical datasets face common issues such as heterogeneous measurements, imbalanced classes with limited sample size, and missing data.
We present a family of prototype-based (PB) interpretable models which are capable of handling these issues.
arXiv Detail & Related papers (2022-06-04T20:20:39Z) - A Relational Model for One-Shot Classification [80.77724423309184]
We show that a deep learning model with built-in inductive bias can bring benefits to sample-efficient learning, without relying on extensive data augmentation.
The proposed one-shot classification model performs relational matching of a pair of inputs in the form of local and pairwise attention.
arXiv Detail & Related papers (2021-11-08T07:53:12Z) - A Twin Neural Model for Uplift [59.38563723706796]
Uplift is a particular case of conditional treatment effect modeling.
We propose a new loss function defined by leveraging a connection with the Bayesian interpretation of the relative risk.
We show our proposed method is competitive with the state-of-the-art in simulation setting and on real data from large scale randomized experiments.
arXiv Detail & Related papers (2021-05-11T16:02:39Z) - Adversarial Sample Enhanced Domain Adaptation: A Case Study on
Predictive Modeling with Electronic Health Records [57.75125067744978]
We propose a data augmentation method to facilitate domain adaptation.
adversarially generated samples are used during domain adaptation.
Results confirm the effectiveness of our method and the generality on different tasks.
arXiv Detail & Related papers (2021-01-13T03:20:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.