High-Dimensional Statistics: Reflections on Progress and Open Problems

• URL: http://arxiv.org/abs/2605.05076v1
• Date: Wed, 06 May 2026 16:11:09 GMT
• Title: High-Dimensional Statistics: Reflections on Progress and Open Problems
• Abstract summary: High-dimensional statistics has evolved to address more sophisticated estimation and inference problems.<n>Our goal is to synthesize advances, highlight common themes and open problems, and point to important works that offer entry points into the field.
• Score: 58.57727026694287
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Over the past two decades, the field of high-dimensional statistics has experienced substantial progress, driven largely by technological advances that have dramatically reduced the cost and effort for data collection and storage across a broad range of domains, including biology, medicine, astronomy, and the social and environmental sciences. Modern datasets are increasingly complex, often exhibiting rich dependency, heterogeneity, and other features that challenge traditional statistical methods. In response, high-dimensional statistics has evolved to address more sophisticated estimation and inference problems. This evolution has, in turn, fostered deep connections with and contributions to a wide range of research areas, including optimization, concentration of measure, random matrix theory, information theory, and theoretical computer science. Given the rapid pace of recent developments in high-dimensional statistics, our goal is to synthesize representative advances, highlight common themes and open problems, and point to important works that offer entry points into the field.

Related papers

• Monocular Depth Estimation from a Single Image: Progress and Opportunities [51.389814411876294]
  This survey traces the field's evolution from early learning-based methods to the emergence of transformative foundation models.<n>We highlight the integration of depth estimation into applications such as visual SLAM, content generation, and robot perception.
  arXiv  Detail & Related papers  (2026-09-01T12:48:10Z)
• Low-dimensional embeddings of high-dimensional data [35.01192808772252]
  Low-dimensional embedding algorithms create low-dimensional representations, or embeddings, for data visualization, exploration, and analysis.<n>Numerous embedding algorithms have been developed, and their usage has become widespread in research and industry.<n>This review provides a detailed and critical overview of recent developments, derive a list of best practices for creating and using low-dimensional embeddings, evaluate popular approaches on a variety of datasets, and discuss the remaining challenges and open problems in the field.
  arXiv  Detail & Related papers  (2025-08-21T19:23:15Z)
• Anomaly Detection and Generation with Diffusion Models: A Survey [51.61574868316922]
  Anomaly detection (AD) plays a pivotal role across diverse domains, including cybersecurity, finance, healthcare, and industrial manufacturing.<n>Recent advancements in deep learning, specifically diffusion models (DMs), have sparked significant interest.<n>This survey aims to guide researchers and practitioners in leveraging DMs for innovative AD solutions across diverse applications.
  arXiv  Detail & Related papers  (2025-06-11T03:29:18Z)
• Multimodal Alignment and Fusion: A Survey [11.3029945633295]
  This survey provides a comprehensive overview of advances in multimodal alignment and fusion within the field of machine learning.<n>We systematically categorize and analyze key approaches to alignment and fusion through both structural perspectives.<n>This survey highlights critical challenges such as cross-modal misalignment, computational bottlenecks, data quality issues, and the modality gap.
  arXiv  Detail & Related papers  (2024-11-26T02:10:27Z)
• Research on the Spatial Data Intelligent Foundation Model [70.47828328840912]
  This report focuses on spatial data intelligent large models, delving into the principles, methods, and cutting-edge applications of these models. It provides an in-depth discussion on the definition, development history, current status, and trends of spatial data intelligent large models. The report systematically elucidates the key technologies of spatial data intelligent large models and their applications in urban environments, aerospace remote sensing, geography, transportation, and other scenarios.
  arXiv  Detail & Related papers  (2024-05-30T06:21:34Z)
• Tensor Methods in High Dimensional Data Analysis: Opportunities and Challenges [16.544309363025324]
  Multiway arrays or tensors are prevalent in modern applications across various fields such as chemometrics, genomics, physics, psychology, and signal processing. Addressing these challenges requires an interdisciplinary approach that brings together tools and insights from statistics, optimization and numerical linear algebra among other fields. This review seeks to examine some of the key advancements and identify common threads among them, under eight different statistical settings.
  arXiv  Detail & Related papers  (2024-05-28T17:54:03Z)
• Foundations and Recent Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions [68.6358773622615]
  This paper provides an overview of the computational and theoretical foundations of multimodal machine learning. We propose a taxonomy of 6 core technical challenges: representation, alignment, reasoning, generation, transference, and quantification. Recent technical achievements will be presented through the lens of this taxonomy, allowing researchers to understand the similarities and differences across new approaches.
  arXiv  Detail & Related papers  (2022-09-07T19:21:19Z)
• Data-Centric Epidemic Forecasting: A Survey [56.99209141838794]
  This survey delves into various data-driven methodological and practical advancements. We enumerate the large number of epidemiological datasets and novel data streams that are relevant to epidemic forecasting. We also discuss experiences and challenges that arise in real-world deployment of these forecasting systems.
  arXiv  Detail & Related papers  (2022-07-19T16:15:11Z)
• Data-Centric Engineering: integrating simulation, machine learning and statistics. Challenges and Opportunities [1.3535770763481905]
  Recent advances in machine learning, coupled with low-cost computation, have led to widespread multi-disciplinary research activity. Mechanistic models, based on physical equations, and purely data-driven statistical approaches represent two ends of the modelling spectrum. New hybrid, data-centric engineering approaches, leveraging the best of both worlds and integrating both simulations and data, are emerging as a powerful tool.
  arXiv  Detail & Related papers  (2021-11-07T22:31:23Z)
• Statistically-Robust Clustering Techniques for Mapping Spatial Hotspots: A Survey [5.169783325693032]
  Clustering techniques required by these domains differ from traditional clustering methods due to the high economic and social costs of spurious results. We present an up-to-date and detailed review of the models and algorithms developed by this field.
  arXiv  Detail & Related papers  (2021-03-22T17:22:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.