Feature Clustering for Support Identification in Extreme Regions
- URL: http://arxiv.org/abs/2008.07365v2
- Date: Mon, 8 Feb 2021 15:54:38 GMT
- Title: Feature Clustering for Support Identification in Extreme Regions
- Authors: Hamid Jalalzai and R\'emi Leluc
- Abstract summary: A common characterization of extremes' dependence structure is the angular measure.
The present paper develops a novel optimization-based approach to assess the dependence structure of extremes.
- Score: 5.6928413790238865
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Understanding the complex structure of multivariate extremes is a major
challenge in various fields from portfolio monitoring and environmental risk
management to insurance. In the framework of multivariate Extreme Value Theory,
a common characterization of extremes' dependence structure is the angular
measure. It is a suitable measure to work in extreme regions as it provides
meaningful insights concerning the subregions where extremes tend to
concentrate their mass. The present paper develops a novel optimization-based
approach to assess the dependence structure of extremes. This support
identification scheme rewrites as estimating clusters of features which best
capture the support of extremes. The dimension reduction technique we provide
is applied to statistical learning tasks such as feature clustering and anomaly
detection. Numerical experiments provide strong empirical evidence of the
relevance of our approach.
Related papers
- Cooperation of Experts: Fusing Heterogeneous Information with Large Margin [11.522412489437702]
Cooperation of Experts (CoE) framework encodes multi-typed information into unified heterogeneous multiplex networks.<n>In our framework, dedicated encoders act as domain-specific experts, each specializing in learning distinct relational patterns in specific semantic spaces.
arXiv Detail & Related papers (2025-05-27T08:04:32Z) - Open-set Anomaly Segmentation in Complex Scenarios [88.11076112792992]
This paper introduces ComsAmy, a benchmark for open-set anomaly segmentation in complex scenarios.
ComsAmy encompasses a wide spectrum of adverse weather conditions, dynamic driving environments, and diverse anomaly types.
We propose a novel energy-entropy learning (EEL) strategy that integrates the complementary information from energy and entropy.
arXiv Detail & Related papers (2025-04-28T12:00:10Z) - Benchmarking the Spatial Robustness of DNNs via Natural and Adversarial Localized Corruptions [49.546479320670464]
This paper introduces specialized metrics for benchmarking the spatial robustness of segmentation models.
We propose region-aware multi-attack adversarial analysis, a method that enables a deeper understanding of model robustness.
The results reveal that models respond to these two types of threats differently.
arXiv Detail & Related papers (2025-04-02T11:37:39Z) - Convergence Rates for Softmax Gating Mixture of Experts [78.3687645289918]
Mixture of experts (MoE) has emerged as an effective framework to advance the efficiency and scalability of machine learning models.
Central to the success of MoE is an adaptive softmax gating mechanism which takes responsibility for determining the relevance of each expert to a given input and then dynamically assigning experts their respective weights.
We perform a convergence analysis of parameter estimation and expert estimation under the MoE equipped with the standard softmax gating or its variants, including a dense-to-sparse gating and a hierarchical softmax gating.
arXiv Detail & Related papers (2025-03-05T06:11:24Z) - PFSD: A Multi-Modal Pedestrian-Focus Scene Dataset for Rich Tasks in Semi-Structured Environments [73.80718037070773]
We present the multi-modal Pedestrian-Focused Scene dataset, rigorously annotated in semi-structured scenes with the format of nuScenes.
We also propose a novel Hybrid Multi-Scale Fusion Network (HMFN) to detect pedestrians in densely populated and occluded scenarios.
arXiv Detail & Related papers (2025-02-21T09:57:53Z) - Inter Observer Variability Assessment through Ordered Weighted Belief Divergence Measure in MAGDM Application to the Ensemble Classifier Feature Fusion [1.3586572110652486]
A large number of multi-attribute group decisionmaking (MAGDM) have been widely introduced to obtain consensus results.
This study aims to propose an Evidential MAGDM method by assessing the inter-observational variability and handling uncertainty.
arXiv Detail & Related papers (2024-09-13T00:53:00Z) - Trusted Unified Feature-Neighborhood Dynamics for Multi-View Classification [16.994115410201974]
Multi-view classification (MVC) faces inherent challenges due to domain gaps and inconsistencies across different views.
We propose a Trusted Unified Feature-NEighborhood Dynamics (TUNED) model for robust MVC.
This method effectively integrates local and global feature-neighborhood (F-N) structures for robust decision-making.
arXiv Detail & Related papers (2024-09-01T15:48:20Z) - GenBench: A Benchmarking Suite for Systematic Evaluation of Genomic Foundation Models [56.63218531256961]
We introduce GenBench, a benchmarking suite specifically tailored for evaluating the efficacy of Genomic Foundation Models.
GenBench offers a modular and expandable framework that encapsulates a variety of state-of-the-art methodologies.
We provide a nuanced analysis of the interplay between model architecture and dataset characteristics on task-specific performance.
arXiv Detail & Related papers (2024-06-01T08:01:05Z) - A Comparative Study on Multi-task Uncertainty Quantification in Semantic Segmentation and Monocular Depth Estimation [9.52671061354338]
We evaluate Monte Carlo Dropout, Deep Sub-Ensembles, and Deep Ensembles for joint semantic segmentation and monocular depth estimation.
Deep Ensembles stand out as the preferred choice, particularly in out-of-domain scenarios.
We highlight the impact of employing different uncertainty thresholds to classify pixels as certain or uncertain.
arXiv Detail & Related papers (2024-05-27T12:12:26Z) - Latent Embedding Clustering for Occlusion Robust Head Pose Estimation [7.620379605206596]
Head pose estimation has become a crucial area of research in computer vision given its usefulness in a wide range of applications.
One of the most difficult challenges in this field is managing head occlusions that frequently take place in real-world scenarios.
We propose a novel and efficient framework that is robust in real world head occlusion scenarios.
arXiv Detail & Related papers (2024-03-29T15:57:38Z) - Revisiting Deep Generalized Canonical Correlation Analysis [30.389620125859356]
Canonical correlation analysis is a classic method for discovering latent co-variation that underpins two or more observed random vectors.
Several extensions and variations of CCA have been proposed that have strengthened our capabilities in terms of revealing common random factors from multiview datasets.
In this work, we first revisit the most recent deterministic extensions of deep CCA and highlight the strengths and limitations of these state-of-the-art methods.
arXiv Detail & Related papers (2023-12-20T22:15:10Z) - Distributionally Robust Model-based Reinforcement Learning with Large
State Spaces [55.14361269378122]
Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment deployment.
We study distributionally robust Markov decision processes with continuous state spaces under the widely used Kullback-Leibler, chi-square, and total variation uncertainty sets.
We propose a model-based approach that utilizes Gaussian Processes and the maximum variance reduction algorithm to efficiently learn multi-output nominal transition dynamics.
arXiv Detail & Related papers (2023-09-05T13:42:11Z) - A VAE Approach to Sample Multivariate Extremes [6.548734807475054]
This paper describes a variational autoencoder (VAE) approach for sampling heavy-tailed distributions likely to have extremes of particularly large intensities.
We illustrate the relevance of our approach on a synthetic data set and on a real data set of discharge measurements along the Danube river network.
In addition to outperforming the standard VAE for the tested data sets, we also provide a comparison with a competing EVT-based generative approach.
arXiv Detail & Related papers (2023-06-19T14:53:40Z) - Learning to Fuse Monocular and Multi-view Cues for Multi-frame Depth
Estimation in Dynamic Scenes [51.20150148066458]
We propose a novel method to learn to fuse the multi-view and monocular cues encoded as volumes without needing the generalizationally crafted masks.
Experiments on real-world datasets prove the significant effectiveness and ability of the proposed method.
arXiv Detail & Related papers (2023-04-18T13:55:24Z) - A Unified Algorithm Framework for Unsupervised Discovery of Skills based
on Determinantal Point Process [53.86223883060367]
We show that diversity and coverage in unsupervised option discovery can indeed be unified under the same mathematical framework.
Our proposed algorithm, ODPP, has undergone extensive evaluation on challenging tasks created with Mujoco and Atari.
arXiv Detail & Related papers (2022-12-01T01:40:03Z) - Cross-domain Object Detection through Coarse-to-Fine Feature Adaptation [62.29076080124199]
This paper proposes a novel coarse-to-fine feature adaptation approach to cross-domain object detection.
At the coarse-grained stage, foreground regions are extracted by adopting the attention mechanism, and aligned according to their marginal distributions.
At the fine-grained stage, we conduct conditional distribution alignment of foregrounds by minimizing the distance of global prototypes with the same category but from different domains.
arXiv Detail & Related papers (2020-03-23T13:40:06Z) - Invariant Causal Prediction for Block MDPs [106.63346115341862]
Generalization across environments is critical to the successful application of reinforcement learning algorithms to real-world challenges.
We propose a method of invariant prediction to learn model-irrelevance state abstractions (MISA) that generalize to novel observations in the multi-environment setting.
arXiv Detail & Related papers (2020-03-12T21:03:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.