Patterns of Cognition: Cognitive Algorithms as Galois Connections
Fulfilled by Chronomorphisms On Probabilistically Typed Metagraphs
- URL: http://arxiv.org/abs/2102.10581v1
- Date: Sun, 21 Feb 2021 10:50:40 GMT
- Title: Patterns of Cognition: Cognitive Algorithms as Galois Connections
Fulfilled by Chronomorphisms On Probabilistically Typed Metagraphs
- Authors: Ben Goertzel
- Abstract summary: It is argued that a broad class of AGI-relevant algorithms can be expressed in a common formal framework.
Examples are drawn from the core cognitive algorithms used in the OpenCog AGI framework.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: It is argued that a broad class of AGI-relevant algorithms can be expressed
in a common formal framework, via specifying Galois connections linking search
and optimization processes on directed metagraphs whose edge targets are
labeled with probabilistic dependent types, and then showing these connections
are fulfilled by processes involving metagraph chronomorphisms. Examples are
drawn from the core cognitive algorithms used in the OpenCog AGI framework:
Probabilistic logical inference, evolutionary program learning, pattern mining,
agglomerative clustering, pattern mining and nonlinear-dynamical attention
allocation.
The analysis presented involves representing these cognitive algorithms as
recursive discrete decision processes involving optimizing functions defined
over metagraphs, in which the key decisions involve sampling from probability
distributions over metagraphs and enacting sets of combinatory operations on
selected sub-metagraphs. The mutual associativity of the combinatory operations
involved in a cognitive process is shown to often play a key role in enabling
the decomposition of the process into folding and unfolding operations; a
conclusion that has some practical implications for the particulars of
cognitive processes, e.g. militating toward use of reversible logic and
reversible program execution. It is also observed that where this mutual
associativity holds, there is an alignment between the hierarchy of subgoals
used in recursive decision process execution and a hierarchy of subpatterns
definable in terms of formal pattern theory.
Related papers
- Homomorphic Encryption of Intuitionistic Logic Proofs and Functional Programs: A Categorical Approach Inspired by Composite-Order Bilinear Groups [0.0]
We present a conceptual framework for extending homomorphic encryption beyond arithmetic or Boolean operations into the domain of intuitionistic logic.
We outline strategies for making the approach potentially efficient, including software optimizations and hardware acceleration.
arXiv Detail & Related papers (2025-02-26T10:10:10Z) - Dynamic Logistic Ensembles with Recursive Probability and Automatic Subset Splitting for Enhanced Binary Classification [2.7396014165932923]
This paper presents a novel approach to binary classification using dynamic logistic ensemble models.
We develop an algorithm that automatically partitions the dataset into multiple subsets, constructing an ensemble of logistic models to enhance classification accuracy.
This work balances computational efficiency with theoretical rigor, providing a robust and interpretable solution for complex classification tasks.
arXiv Detail & Related papers (2024-11-27T00:22:55Z) - Multi-objective Binary Differential Approach with Parameter Tuning for Discovering Business Process Models: MoD-ProM [2.3423913554158653]
We consider the Binary Differential Evolution approach in a multi-objective framework for the task of process discovery.
It is shown that the process models generated by the proposed approach are superior to or at least as good as those generated by the state-of-the-art algorithms.
arXiv Detail & Related papers (2024-06-25T16:53:55Z) - SymbolicAI: A framework for logic-based approaches combining generative models and solvers [9.841285581456722]
We introduce SymbolicAI, a versatile and modular framework employing a logic-based approach to concept learning and flow management in generative processes.
We treat large language models (LLMs) as semantic solvers that execute tasks based on both natural and formal language instructions.
arXiv Detail & Related papers (2024-02-01T18:50:50Z) - Discrete, compositional, and symbolic representations through attractor dynamics [51.20712945239422]
We introduce a novel neural systems model that integrates attractor dynamics with symbolic representations to model cognitive processes akin to the probabilistic language of thought (PLoT)
Our model segments the continuous representational space into discrete basins, with attractor states corresponding to symbolic sequences, that reflect the semanticity and compositionality characteristic of symbolic systems through unsupervised learning, rather than relying on pre-defined primitives.
This approach establishes a unified framework that integrates both symbolic and sub-symbolic processing through neural dynamics, a neuroplausible substrate with proven expressivity in AI, offering a more comprehensive model that mirrors the complex duality of cognitive operations
arXiv Detail & Related papers (2023-10-03T05:40:56Z) - Object Representations as Fixed Points: Training Iterative Refinement
Algorithms with Implicit Differentiation [88.14365009076907]
Iterative refinement is a useful paradigm for representation learning.
We develop an implicit differentiation approach that improves the stability and tractability of training.
arXiv Detail & Related papers (2022-07-02T10:00:35Z) - Object Type Clustering using Markov Directly-Follow Multigraph in
Object-Centric Process Mining [2.3351527694849574]
This paper introduces a new approach to cluster similar case notions based on Markov Directly-Follow Multigraph.
A threshold tuning algorithm is also defined to identify sets of different clusters that can be discovered based on different levels of similarity.
arXiv Detail & Related papers (2022-06-22T12:36:46Z) - Deep Equilibrium Assisted Block Sparse Coding of Inter-dependent
Signals: Application to Hyperspectral Imaging [71.57324258813675]
A dataset of inter-dependent signals is defined as a matrix whose columns demonstrate strong dependencies.
A neural network is employed to act as structure prior and reveal the underlying signal interdependencies.
Deep unrolling and Deep equilibrium based algorithms are developed, forming highly interpretable and concise deep-learning-based architectures.
arXiv Detail & Related papers (2022-03-29T21:00:39Z) - Formalization of a Stochastic Approximation Theorem [0.22940141855172028]
approximation algorithms are iterative procedures which are used to approximate a target value in an environment where the target is unknown.
Originally introduced in a 1951 paper by Robbins and Monro, the field of approximation has grown enormously and has come to influence application domains.
arXiv Detail & Related papers (2022-02-12T02:31:14Z) - Fractal Structure and Generalization Properties of Stochastic
Optimization Algorithms [71.62575565990502]
We prove that the generalization error of an optimization algorithm can be bounded on the complexity' of the fractal structure that underlies its generalization measure.
We further specialize our results to specific problems (e.g., linear/logistic regression, one hidden/layered neural networks) and algorithms.
arXiv Detail & Related papers (2021-06-09T08:05:36Z) - Process Discovery for Structured Program Synthesis [70.29027202357385]
A core task in process mining is process discovery which aims to learn an accurate process model from event log data.
In this paper, we propose to use (block-) structured programs directly as target process models.
We develop a novel bottom-up agglomerative approach to the discovery of such structured program process models.
arXiv Detail & Related papers (2020-08-13T10:33:10Z) - Distributed Value Function Approximation for Collaborative Multi-Agent
Reinforcement Learning [2.7071541526963805]
We propose several novel distributed gradient-based temporal difference algorithms for multi-agent off-policy learning.
The proposed algorithms differ by their form, definition of eligibility traces, selection of time scales and the way of incorporating consensus iterations.
It is demonstrated how the adopted methodology can be applied to temporal-difference algorithms under weaker information structure constraints.
arXiv Detail & Related papers (2020-06-18T11:46:09Z) - Learned Factor Graphs for Inference from Stationary Time Sequences [107.63351413549992]
We propose a framework that combines model-based algorithms and data-driven ML tools for stationary time sequences.
neural networks are developed to separately learn specific components of a factor graph describing the distribution of the time sequence.
We present an inference algorithm based on learned stationary factor graphs, which learns to implement the sum-product scheme from labeled data.
arXiv Detail & Related papers (2020-06-05T07:06:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.