Towards Interpreting Multi-Objective Feature Associations
- URL: http://arxiv.org/abs/2403.00017v1
- Date: Wed, 28 Feb 2024 02:24:04 GMT
- Title: Towards Interpreting Multi-Objective Feature Associations
- Authors: Nisha Pillai, Ganga Gireesan, Michael J. Rothrock Jr., Bindu Nanduri,
Zhiqian Chen, Mahalingam Ramkumar
- Abstract summary: We propose an objective specific feature interaction using multi-labels to find the optimal combination of features in agricultural settings.
Results indicate that explanation-based approaches are capable of identifying combinations of features that reduce pathogen presence in fewer than a baseline.
- Score: 5.794844059546945
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Understanding how multiple features are associated and contribute to a
specific objective is as important as understanding how each feature
contributes to a particular outcome. Interpretability of a single feature in a
prediction may be handled in multiple ways; however, in a multi-objective
prediction, it is difficult to obtain interpretability of a combination of
feature values. To address this issue, we propose an objective specific feature
interaction design using multi-labels to find the optimal combination of
features in agricultural settings. One of the novel aspects of this design is
the identification of a method that integrates feature explanations with global
sensitivity analysis in order to ensure combinatorial optimization in
multi-objective settings. We have demonstrated in our preliminary experiments
that an approximate combination of feature values can be found to achieve the
desired outcome using two agricultural datasets: one with pre-harvest poultry
farm practices for multi-drug resistance presence, and one with post-harvest
poultry farm practices for food-borne pathogens. In our combinatorial
optimization approach, all three pathogens are taken into consideration
simultaneously to account for the interaction between conditions that favor
different types of pathogen growth. These results indicate that
explanation-based approaches are capable of identifying combinations of
features that reduce pathogen presence in fewer iterations than a baseline.
Related papers
- Bayesian Joint Additive Factor Models for Multiview Learning [7.254731344123118]
A motivating application arises in the context of precision medicine where multi-omics data are collected to correlate with clinical outcomes.
We propose a joint additive factor regression model (JAFAR) with a structured additive design, accounting for shared and view-specific components.
Prediction of time-to-labor onset from immunome, metabolome, and proteome data illustrates performance gains against state-of-the-art competitors.
arXiv Detail & Related papers (2024-06-02T15:35:45Z) - Unifying Feature and Cost Aggregation with Transformers for Semantic and Visual Correspondence [51.54175067684008]
This paper introduces a Transformer-based integrative feature and cost aggregation network designed for dense matching tasks.
We first show that feature aggregation and cost aggregation exhibit distinct characteristics and reveal the potential for substantial benefits stemming from the judicious use of both aggregation processes.
Our framework is evaluated on standard benchmarks for semantic matching, and also applied to geometric matching, where we show that our approach achieves significant improvements compared to existing methods.
arXiv Detail & Related papers (2024-03-17T07:02:55Z) - Enhancing Neural Subset Selection: Integrating Background Information into Set Representations [53.15923939406772]
We show that when the target value is conditioned on both the input set and subset, it is essential to incorporate an textitinvariant sufficient statistic of the superset into the subset of interest.
This ensures that the output value remains invariant to permutations of the subset and its corresponding superset, enabling identification of the specific superset from which the subset originated.
arXiv Detail & Related papers (2024-02-05T16:09:35Z) - Automated Model Selection for Tabular Data [0.1797555376258229]
R's mixed effect linear models library allows users to provide interactive feature combinations in the model design.
We aim to automate the model selection process for predictions on datasets incorporating feature interactions.
The framework includes two distinct approaches for feature selection: a Priority-based Random Grid Search and a Greedy Search method.
arXiv Detail & Related papers (2024-01-01T21:41:20Z) - A metaheuristic multi-objective interaction-aware feature selection
method [5.28539620288341]
We present a novel multi-objective feature selection method that has several advantages.
It considers the interaction between features using an advanced probability scheme.
The proposed method utilizes the introduced probability scheme to produce more promising offsprings.
arXiv Detail & Related papers (2022-11-10T08:56:48Z) - PropertyDAG: Multi-objective Bayesian optimization of partially ordered,
mixed-variable properties for biological sequence design [42.92794039060737]
We present PropertyDAG, a framework that operates on top of the traditional multi-objective BO to impose this desired ordering on the objectives.
We demonstrate its performance over multiple simulated active learning iterations on a penicillin production task, toy numerical problem, and a real-world antibody design task.
arXiv Detail & Related papers (2022-10-08T19:42:16Z) - On Inductive Biases for Heterogeneous Treatment Effect Estimation [91.3755431537592]
We investigate how to exploit structural similarities of an individual's potential outcomes (POs) under different treatments.
We compare three end-to-end learning strategies to overcome this problem.
arXiv Detail & Related papers (2021-06-07T16:30:46Z) - Self-Supervised Multimodal Domino: in Search of Biomarkers for
Alzheimer's Disease [19.86082635340699]
We propose a taxonomy of all reasonable ways to organize self-supervised representation-learning algorithms.
We first evaluate models on toy multimodal MNIST datasets and then apply them to a multimodal neuroimaging dataset with Alzheimer's disease patients.
Results show that the proposed approach outperforms previous self-supervised encoder-decoder methods.
arXiv Detail & Related papers (2020-12-25T20:28:13Z) - Combining Task Predictors via Enhancing Joint Predictability [53.46348489300652]
We present a new predictor combination algorithm that improves the target by i) measuring the relevance of references based on their capabilities in predicting the target, and ii) strengthening such estimated relevance.
Our algorithm jointly assesses the relevance of all references by adopting a Bayesian framework.
Based on experiments on seven real-world datasets from visual attribute ranking and multi-class classification scenarios, we demonstrate that our algorithm offers a significant performance gain and broadens the application range of existing predictor combination approaches.
arXiv Detail & Related papers (2020-07-15T21:58:39Z) - A Trainable Optimal Transport Embedding for Feature Aggregation and its
Relationship to Attention [96.77554122595578]
We introduce a parametrized representation of fixed size, which embeds and then aggregates elements from a given input set according to the optimal transport plan between the set and a trainable reference.
Our approach scales to large datasets and allows end-to-end training of the reference, while also providing a simple unsupervised learning mechanism with small computational cost.
arXiv Detail & Related papers (2020-06-22T08:35:58Z) - Adaptive Object Detection with Dual Multi-Label Prediction [78.69064917947624]
We propose a novel end-to-end unsupervised deep domain adaptation model for adaptive object detection.
The model exploits multi-label prediction to reveal the object category information in each image.
We introduce a prediction consistency regularization mechanism to assist object detection.
arXiv Detail & Related papers (2020-03-29T04:23:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.