Raven's Progressive Matrices Completion with Latent Gaussian Process Priors

• URL: http://arxiv.org/abs/2103.12045v1
• Date: Mon, 22 Mar 2021 17:48:44 GMT
• Title: Raven's Progressive Matrices Completion with Latent Gaussian Process Priors
• Authors: Fan Shi, Bin Li, Xiangyang Xue
• Abstract summary: Raven's Progressive Matrices (RPM) are widely used in human IQ tests. We propose a deep latent variable model, in which multiple Gaussian processes are employed as priors of latent variables. We evaluate the proposed model on RPM-like datasets with multiple continuously-changing visual concepts.
• Score: 42.310737373877714
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Abstract reasoning ability is fundamental to human intelligence. It enables humans to uncover relations among abstract concepts and further deduce implicit rules from the relations. As a well-known abstract visual reasoning task, Raven's Progressive Matrices (RPM) are widely used in human IQ tests. Although extensive research has been conducted on RPM solvers with machine intelligence, few studies have considered further advancing the standard answer-selection (classification) problem to a more challenging answer-painting (generating) problem, which can verify whether the model has indeed understood the implicit rules. In this paper we aim to solve the latter one by proposing a deep latent variable model, in which multiple Gaussian processes are employed as priors of latent variables to separately learn underlying abstract concepts from RPMs; thus the proposed model is interpretable in terms of concept-specific latent variables. The latent Gaussian process also provides an effective way of extrapolation for answer painting based on the learned concept-changing rules. We evaluate the proposed model on RPM-like datasets with multiple continuously-changing visual concepts. Experimental results demonstrate that our model requires only few training samples to paint high-quality answers, generate novel RPM panels, and achieve interpretability through concept-specific latent variables.

Related papers

• A Feature-based Generalizable Prediction Model for Both Perceptual and Abstract Reasoning [1.0650780147044159]
  A hallmark of human intelligence is the ability to infer abstract rules from limited experience. Recent advances in deep learning have led to multiple artificial neural network models matching or even surpassing human performance. We present an algorithmic approach to rule detection and application using feature detection, affine transformation estimation and search.
  arXiv  Detail & Related papers  (2024-03-08T19:26:30Z)
• Towards Generative Abstract Reasoning: Completing Raven's Progressive Matrix via Rule Abstraction and Selection [52.107043437362556]
  Raven's Progressive Matrix (RPM) is widely used to probe abstract visual reasoning in machine intelligence. Participators of RPM tests can show powerful reasoning ability by inferring and combining attribute-changing rules. We propose a deep latent variable model for answer generation problems through Rule AbstractIon and SElection.
  arXiv  Detail & Related papers  (2024-01-18T13:28:44Z)
• Learning Abstract Visual Reasoning via Task Decomposition: A Case Study in Raven Progressive Matrices [0.24475591916185496]
  In Raven Progressive Matrices, the task is to choose one of the available answers given a context. In this study, we propose a deep learning architecture based on the transformer blueprint. The multidimensional predictions obtained in this way are then directly juxtaposed to choose the answer.
  arXiv  Detail & Related papers  (2023-08-12T11:02:21Z)
• Abstracting Concept-Changing Rules for Solving Raven's Progressive Matrix Problems [54.26307134687171]
  Raven's Progressive Matrix (RPM) is a classic test to realize such ability in machine intelligence by selecting from candidates. Recent studies suggest that solving RPM in an answer-generation way boosts a more in-depth understanding of rules. We propose a deep latent variable model for Concept-changing Rule ABstraction (CRAB) by learning interpretable concepts and parsing concept-changing rules in the latent space.
  arXiv  Detail & Related papers  (2023-07-15T07:16:38Z)
• Multi-Viewpoint and Multi-Evaluation with Felicitous Inductive Bias Boost Machine Abstract Reasoning Ability [6.33280703577189]
  We show that end-to-end neural networks embodied with inductive bias, intentionally design or serendipitously match, can solve RPM problems. Our work also reveals that multi-viewpoint with multi-evaluation is a key learning strategy for successful reasoning. We hope that these results will serve as inspections of AI's ability beyond perception and toward abstract reasoning.
  arXiv  Detail & Related papers  (2022-10-26T17:15:44Z)
• elBERto: Self-supervised Commonsense Learning for Question Answering [131.51059870970616]
  We propose a Self-supervised Bidirectional Representation Learning of Commonsense framework, which is compatible with off-the-shelf QA model architectures. The framework comprises five self-supervised tasks to force the model to fully exploit the additional training signals from contexts containing rich commonsense. elBERto achieves substantial improvements on out-of-paragraph and no-effect questions where simple lexical similarity comparison does not help.
  arXiv  Detail & Related papers  (2022-03-17T16:23:45Z)
• DAReN: A Collaborative Approach Towards Reasoning And Disentangling [27.50150027974947]
  We propose an end-to-end joint representation-reasoning learning framework, which leverages a weak form of inductive bias to improve both tasks together. We accomplish this using a novel learning framework Disentangling based Abstract Reasoning Network (DAReN) based on the principles of GM-RPM.
  arXiv  Detail & Related papers  (2021-09-27T16:10:30Z)
• Unsupervised Abstract Reasoning for Raven's Problem Matrices [9.278113063631643]
  Raven's Progressive Matrices ( RPM) is highly correlated with human intelligence. We propose the first unsupervised learning method for solving RPM problems. Our method even outperforms some of the supervised approaches.
  arXiv  Detail & Related papers  (2021-09-21T07:44:58Z)
• Abstract Spatial-Temporal Reasoning via Probabilistic Abduction and Execution [97.50813120600026]
  Spatial-temporal reasoning is a challenging task in Artificial Intelligence (AI) Recent works have focused on an abstract reasoning task of this kind -- Raven's Progressive Matrices ( RPM) We propose a neuro-symbolic Probabilistic Abduction and Execution learner (PrAE) learner.
  arXiv  Detail & Related papers  (2021-03-26T02:42:18Z)
• Text Modular Networks: Learning to Decompose Tasks in the Language of Existing Models [61.480085460269514]
  We propose a framework for building interpretable systems that learn to solve complex tasks by decomposing them into simpler ones solvable by existing models. We use this framework to build ModularQA, a system that can answer multi-hop reasoning questions by decomposing them into sub-questions answerable by a neural factoid single-span QA model and a symbolic calculator.
  arXiv  Detail & Related papers  (2020-09-01T23:45:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.