Machine-Learning Mathematical Structures
- URL: http://arxiv.org/abs/2101.06317v1
- Date: Fri, 15 Jan 2021 22:48:19 GMT
- Title: Machine-Learning Mathematical Structures
- Authors: Yang-Hui He
- Abstract summary: We present a comparative study of the accuracies on different problems.
The paradigm should be useful for conjecture formulation, finding more efficient methods of computation, as well as probing into certain hierarchy of structures in mathematics.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We review, for a general audience, a variety of recent experiments on
extracting structure from machine-learning mathematical data that have been
compiled over the years. Focusing on supervised machine-learning on labeled
data from different fields ranging from geometry to representation theory, from
combinatorics to number theory, we present a comparative study of the
accuracies on different problems. The paradigm should be useful for conjecture
formulation, finding more efficient methods of computation, as well as probing
into certain hierarchy of structures in mathematics.
Related papers
- Machine Learning and Data Analysis Using Posets: A Survey [0.0]
Posets are discrete mathematical structures ubiquitous in a broad range of data analysis and machine learning applications.
Research connecting posets to the data science domain has been ongoing for many years.
arXiv Detail & Related papers (2024-04-03T21:47:44Z) - How Do Transformers Learn Topic Structure: Towards a Mechanistic
Understanding [56.222097640468306]
We provide mechanistic understanding of how transformers learn "semantic structure"
We show, through a combination of mathematical analysis and experiments on Wikipedia data, that the embedding layer and the self-attention layer encode the topical structure.
arXiv Detail & Related papers (2023-03-07T21:42:17Z) - Computing with Categories in Machine Learning [1.7679374058425343]
We introduce DisCoPyro as a categorical structure learning framework.
DisCoPyro combines categorical structures with amortized variational inference.
We speculate that DisCoPyro could ultimately contribute to the development of artificial general intelligence.
arXiv Detail & Related papers (2023-03-07T17:26:18Z) - Towards a Holistic Understanding of Mathematical Questions with
Contrastive Pre-training [65.10741459705739]
We propose a novel contrastive pre-training approach for mathematical question representations, namely QuesCo.
We first design two-level question augmentations, including content-level and structure-level, which generate literally diverse question pairs with similar purposes.
Then, to fully exploit hierarchical information of knowledge concepts, we propose a knowledge hierarchy-aware rank strategy.
arXiv Detail & Related papers (2023-01-18T14:23:29Z) - A Survey of Deep Learning for Mathematical Reasoning [71.88150173381153]
We review the key tasks, datasets, and methods at the intersection of mathematical reasoning and deep learning over the past decade.
Recent advances in large-scale neural language models have opened up new benchmarks and opportunities to use deep learning for mathematical reasoning.
arXiv Detail & Related papers (2022-12-20T18:46:16Z) - Multiparameter Persistent Homology-Generic Structures and Quantum
Computing [0.0]
This article is an application of commutative algebra to the study of persistent homology in topological data analysis.
The generic structure of such resolutions and the classifying spaces are studied using results spanning several decades of research.
arXiv Detail & Related papers (2022-10-20T17:30:20Z) - Model-agnostic multi-objective approach for the evolutionary discovery
of mathematical models [55.41644538483948]
In modern data science, it is more interesting to understand the properties of the model, which parts could be replaced to obtain better results.
We use multi-objective evolutionary optimization for composite data-driven model learning to obtain the algorithm's desired properties.
arXiv Detail & Related papers (2021-07-07T11:17:09Z) - The Mathematical Foundations of Manifold Learning [6.929312022493406]
This thesis presents a mathematical perspective on manifold learning.
It delves into the intersection of kernel learning, spectral graph theory, and differential geometry.
Emphasis is placed on the remarkable interplay between graphs and manifold regularization.
arXiv Detail & Related papers (2020-10-30T12:04:20Z) - Marginal likelihood computation for model selection and hypothesis
testing: an extensive review [66.37504201165159]
This article provides a comprehensive study of the state-of-the-art of the topic.
We highlight limitations, benefits, connections and differences among the different techniques.
Problems and possible solutions with the use of improper priors are also described.
arXiv Detail & Related papers (2020-05-17T18:31:58Z) - Stochastic Flows and Geometric Optimization on the Orthogonal Group [52.50121190744979]
We present a new class of geometrically-driven optimization algorithms on the orthogonal group $O(d)$.
We show that our methods can be applied in various fields of machine learning including deep, convolutional and recurrent neural networks, reinforcement learning, flows and metric learning.
arXiv Detail & Related papers (2020-03-30T15:37:50Z) - Geometric Formulation for Discrete Points and its Applications [0.0]
We introduce a novel formulation for geometry on discrete points.
It is based on a universal differential calculus, which gives a geometric description of a discrete set by the algebra of functions.
arXiv Detail & Related papers (2020-02-07T01:12:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.