Dynamic Kernel Matching for Non-conforming Data: A Case Study of T-cell
Receptor Datasets
- URL: http://arxiv.org/abs/2103.10472v1
- Date: Thu, 18 Mar 2021 18:39:14 GMT
- Title: Dynamic Kernel Matching for Non-conforming Data: A Case Study of T-cell
Receptor Datasets
- Abstract summary: We describe an approach for modifying established statistical classifiers to handle non-conforming data.
We consider (i) a dataset of T-cell receptor (TCR) sequences labelled by disease antigen and (ii) a dataset of sequenced TCR repertoires labelled by patient cytomegalovirus (CMV) serostatus.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Most statistical classifiers are designed to find patterns in data where
numbers fit into rows and columns, like in a spreadsheet, but many kinds of
data do not conform to this structure. To uncover patterns in non-conforming
data, we describe an approach for modifying established statistical classifiers
to handle non-conforming data, which we call dynamic kernel matching (DKM). As
examples of non-conforming data, we consider (i) a dataset of T-cell receptor
(TCR) sequences labelled by disease antigen and (ii) a dataset of sequenced TCR
repertoires labelled by patient cytomegalovirus (CMV) serostatus, anticipating
that both datasets contain signatures for diagnosing disease. We successfully
fit statistical classifiers augmented with DKM to both datasets and report the
performance on holdout data using standard metrics and metrics allowing for
indeterminant diagnoses. Finally, we identify the patterns used by our
statistical classifiers to generate predictions and show that these patterns
agree with observations from experimental studies.
Related papers
- Copula Adapted Directed Acyclic Graph for Cluster Representation of Biomedical Data [0.0]
Stratifying unlabeled biomedical data based on complex relationships between features eliminates the need for data labels.<n>Traditional clustering methods assume restrictive data distributions, making them suboptimal for capturing complex dependencies.<n>This paper introduces a novel cluster-friendly data presentation framework that integrates the non-Gaussian and non-linear feature dependence of copula models.
arXiv Detail & Related papers (2026-09-14T19:07:53Z) - Unsupervised Skill Discovery for Agentic Data Analysis [55.42853694128929]
DataCOPE is an unsupervised verifier-guided skill discovery framework for data-analytic agents.<n>It iteratively coordinates a Data-Analytic Agent for trajectory generation, an Unsupervised Verifier for signal extraction, and a Skill Manager for contrastive skill distillation.<n>We evaluate DataCOPE on report-style analysis from Deep Data Research and reasoning-style analysis from DABStep.
arXiv Detail & Related papers (2026-06-04T17:20:47Z) - idSCD: Identifying Training Datasets through Semantic Correlation Descriptors [5.756453494739546]
We argue that datasets leave dataset-specific traces in a model's learned semantic correlation structure.<n>We introduce a white-box semantic fingerprinting approach based on semantic correlation descriptors (SCDs)<n>We propose a practical SCD-based membership score that tests whether a target dataset is part of a model's training mixture.
arXiv Detail & Related papers (2026-05-28T18:38:15Z) - Statistical Embeddings for Similarity, Retrieval, and Interpretable Alignment of Numeric Tabular Datasets [0.0]
The proposed methodology characterizes numeric datasets through structured exploratory data analysis descriptors.<n>A penalized formulation of Canonical Correlation Analysis (CCA) is applied to recover sparse, interpretable variable-level correspondences.<n>The methodology is evaluated across 15 datasets spanning general-purpose benchmarks, materials informatics, and nuclear-grade graphite characterization.
arXiv Detail & Related papers (2026-05-28T17:40:42Z) - Generating Logically Consistent Synthetic Supply Chain Data with LLM-Driven Knowledge Graph Reasoning [51.78065387034195]
This paper introduces textbftextitTabKG, a knowledge-graph-guided framework for logically consistent synthetic supply chain data generation.
arXiv Detail & Related papers (2026-05-26T10:41:37Z) - TSFM in-context learning for time-series classification of bearing-health status [2.1569807291469454]
This paper introduces a classification method using in-context learning in time-series foundation models (TSFM)<n>We show how data, which was not part of the TSFM training data corpus, can be classified without the need of finetuning the model.<n>We apply this method to vibration data for assessing the health state of a bearing within a servo-press motor.
arXiv Detail & Related papers (2025-11-19T14:01:12Z) - Time-to-event prediction for grouped variables using Exclusive Lasso [0.0]
We propose utilizing Exclusive Lasso regularization in place of standard Lasso penalization.
We apply our methodology to a real-life cancer dataset, demonstrating enhanced survival prediction performance compared to the conventional Cox regression model.
arXiv Detail & Related papers (2025-04-02T09:07:05Z) - TabDiff: a Mixed-type Diffusion Model for Tabular Data Generation [91.50296404732902]
We introduce TabDiff, a joint diffusion framework that models all mixed-type distributions of tabular data in one model.
Our key innovation is the development of a joint continuous-time diffusion process for numerical and categorical data.
TabDiff achieves superior average performance over existing competitive baselines, with up to $22.5%$ improvement over the state-of-the-art model on pair-wise column correlation estimations.
arXiv Detail & Related papers (2024-10-27T22:58:47Z) - Induced Covariance for Causal Discovery in Linear Sparse Structures [55.2480439325792]
Causal models seek to unravel the cause-effect relationships among variables from observed data.
This paper introduces a novel causal discovery algorithm designed for settings in which variables exhibit linearly sparse relationships.
arXiv Detail & Related papers (2024-10-02T04:01:38Z) - DAGnosis: Localized Identification of Data Inconsistencies using
Structures [73.39285449012255]
Identification and appropriate handling of inconsistencies in data at deployment time is crucial to reliably use machine learning models.
We use directed acyclic graphs (DAGs) to encode the training set's features probability distribution and independencies as a structure.
Our method, called DAGnosis, leverages these structural interactions to bring valuable and insightful data-centric conclusions.
arXiv Detail & Related papers (2024-02-26T11:29:16Z) - Training-Free Generalization on Heterogeneous Tabular Data via
Meta-Representation [67.30538142519067]
We propose Tabular data Pre-Training via Meta-representation (TabPTM)
A deep neural network is then trained to associate these meta-representations with dataset-specific classification confidences.
Experiments validate that TabPTM achieves promising performance in new datasets, even under few-shot scenarios.
arXiv Detail & Related papers (2023-10-31T18:03:54Z) - Beyond Individual Input for Deep Anomaly Detection on Tabular Data [0.0]
Anomaly detection is vital in many domains, such as finance, healthcare, and cybersecurity.
To the best of our knowledge, this is the first work to successfully combine feature-feature and sample-sample dependencies.
Our method achieves state-of-the-art performance, outperforming existing methods by 2.4% and 1.2% in terms of F1-score and AUROC, respectively.
arXiv Detail & Related papers (2023-05-24T13:13:26Z) - Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular
data [81.43750358586072]
We propose Data-IQ, a framework to systematically stratify examples into subgroups with respect to their outcomes.
We experimentally demonstrate the benefits of Data-IQ on four real-world medical datasets.
arXiv Detail & Related papers (2022-10-24T08:57:55Z) - VAESim: A probabilistic approach for self-supervised prototype discovery [0.23624125155742057]
We propose an architecture for image stratification based on a conditional variational autoencoder.
We use a continuous latent space to represent the continuum of disorders and find clusters during training, which can then be used for image/patient stratification.
We demonstrate that our method outperforms baselines in terms of kNN accuracy measured on a classification task against a standard VAE.
arXiv Detail & Related papers (2022-09-25T17:55:31Z) - Data-SUITE: Data-centric identification of in-distribution incongruous
examples [81.21462458089142]
Data-SUITE is a data-centric framework to identify incongruous regions of in-distribution (ID) data.
We empirically validate Data-SUITE's performance and coverage guarantees.
arXiv Detail & Related papers (2022-02-17T18:58:31Z) - Medical data wrangling with sequential variational autoencoders [5.9207487081080705]
This paper proposes to model medical data records with heterogeneous data types and bursty missing data using sequential variational autoencoders (VAEs)
We show that Shi-VAE achieves the best performance in terms of using both metrics, with lower computational complexity than the GP-VAE model.
arXiv Detail & Related papers (2021-03-12T10:59:26Z) - Modeling Heterogeneous Statistical Patterns in High-dimensional Data by
Adversarial Distributions: An Unsupervised Generative Framework [33.652544673163774]
We propose a novel unsupervised generative framework called FIRD, which utilizes adversarial distributions to fit and disentangle the heterogeneous statistical patterns.
When applying to discrete spaces, FIRD effectively distinguishes the synchronized fraudsters from normal users.
arXiv Detail & Related papers (2020-12-15T08:51:20Z) - Trajectories, bifurcations and pseudotime in large clinical datasets:
applications to myocardial infarction and diabetes data [94.37521840642141]
We suggest a semi-supervised methodology for the analysis of large clinical datasets, characterized by mixed data types and missing values.
The methodology is based on application of elastic principal graphs which can address simultaneously the tasks of dimensionality reduction, data visualization, clustering, feature selection and quantifying the geodesic distances (pseudotime) in partially ordered sequences of observations.
arXiv Detail & Related papers (2020-07-07T21:04:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.