Visual Memorability for Robotic Interestingness via Unsupervised Online Learning

• URL: http://arxiv.org/abs/2005.08829v3
• Date: Sat, 18 Jul 2020 16:43:35 GMT
• Title: Visual Memorability for Robotic Interestingness via Unsupervised Online Learning
• Authors: Chen Wang, Wenshan Wang, Yuheng Qiu, Yafei Hu, and Sebastian Scherer
• Abstract summary: We propose a novel translation-invariant visual memory for recalling and identifying interesting scenes. This enables our system to learn human-like experience, environmental knowledge, and online adaption. Our approach achieves much higher accuracy than the state-of-the-art algorithms on challenging robotic interestingness datasets.
• Score: 8.747798544090314
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we explore the problem of interesting scene prediction for mobile robots. This area is currently underexplored but is crucial for many practical applications such as autonomous exploration and decision making. Inspired by industrial demands, we first propose a novel translation-invariant visual memory for recalling and identifying interesting scenes, then design a three-stage architecture of long-term, short-term, and online learning. This enables our system to learn human-like experience, environmental knowledge, and online adaption, respectively. Our approach achieves much higher accuracy than the state-of-the-art algorithms on challenging robotic interestingness datasets.

Related papers

• A Survey of Embodied Learning for Object-Centric Robotic Manipulation [27.569063968870868]
  Embodied learning for object-centric robotic manipulation is a rapidly developing and challenging area in AI. Unlike data-driven machine learning methods, embodied learning focuses on robot learning through physical interaction with the environment.
  arXiv  Detail & Related papers  (2024-08-21T11:32:09Z)
• Commonsense Reasoning for Legged Robot Adaptation with Vision-Language Models [81.55156507635286]
  Legged robots are physically capable of navigating a diverse variety of environments and overcoming a wide range of obstructions. Current learning methods often struggle with generalization to the long tail of unexpected situations without heavy human supervision. We propose a system, VLM-Predictive Control (VLM-PC), combining two key components that we find to be crucial for eliciting on-the-fly, adaptive behavior selection.
  arXiv  Detail & Related papers  (2024-07-02T21:00:30Z)
• Visual Episodic Memory-based Exploration [0.6374763930914523]
  In humans, intrinsic motivation is an important mechanism for open-ended cognitive development; in robots, it has been to be valuable for exploration. This paper explores the use of visual episodic memory as a source of motivation for robotic exploration problems.
  arXiv  Detail & Related papers  (2024-05-18T13:58:47Z)
• Enhancing Robot Learning through Learned Human-Attention Feature Maps [6.724036710994883]
  We think that embedding auxiliary information about focus point into robot learning would enhance efficiency and robustness of the learning process. In this paper, we propose a novel approach to model and emulate the human attention with an approximate prediction model. We test our approach on two learning tasks - object detection and imitation learning.
  arXiv  Detail & Related papers  (2023-08-29T14:23:44Z)
• Challenges in Visual Anomaly Detection for Mobile Robots [65.53820325712455]
  We consider the task of detecting anomalies for autonomous mobile robots based on vision. We categorize relevant types of visual anomalies and discuss how they can be detected by unsupervised deep learning methods.
  arXiv  Detail & Related papers  (2022-09-22T13:26:46Z)
• OG-SGG: Ontology-Guided Scene Graph Generation. A Case Study in Transfer Learning for Telepresence Robotics [124.08684545010664]
  Scene graph generation from images is a task of great interest to applications such as robotics. We propose an initial approximation to a framework called Ontology-Guided Scene Graph Generation (OG-SGG)
  arXiv  Detail & Related papers  (2022-02-21T13:23:15Z)
• Unsupervised Online Learning for Robotic Interestingness with Visual Memory [9.189959184116962]
  We develop a method that automatically adapts online to the environment to report interesting scenes quickly. We achieve an average of 20% higher accuracy than the state-of-the-art unsupervised methods in a subterranean tunnel environment.
  arXiv  Detail & Related papers  (2021-11-18T16:51:39Z)
• Low Dimensional State Representation Learning with Robotics Priors in Continuous Action Spaces [8.692025477306212]
  Reinforcement learning algorithms have proven to be capable of solving complicated robotics tasks in an end-to-end fashion. We propose a framework combining the learning of a low-dimensional state representation, from high-dimensional observations coming from the robot's raw sensory readings, with the learning of the optimal policy.
  arXiv  Detail & Related papers  (2021-07-04T15:42:01Z)
• Actionable Models: Unsupervised Offline Reinforcement Learning of Robotic Skills [93.12417203541948]
  We propose the objective of learning a functional understanding of the environment by learning to reach any goal state in a given dataset. We find that our method can operate on high-dimensional camera images and learn a variety of skills on real robots that generalize to previously unseen scenes and objects.
  arXiv  Detail & Related papers  (2021-04-15T20:10:11Z)
• Rapid Exploration for Open-World Navigation with Latent Goal Models [78.45339342966196]
  We describe a robotic learning system for autonomous exploration and navigation in diverse, open-world environments. At the core of our method is a learned latent variable model of distances and actions, along with a non-parametric topological memory of images. We use an information bottleneck to regularize the learned policy, giving us (i) a compact visual representation of goals, (ii) improved generalization capabilities, and (iii) a mechanism for sampling feasible goals for exploration.
  arXiv  Detail & Related papers  (2021-04-12T23:14:41Z)
• ViNG: Learning Open-World Navigation with Visual Goals [82.84193221280216]
  We propose a learning-based navigation system for reaching visually indicated goals. We show that our system, which we call ViNG, outperforms previously-proposed methods for goal-conditioned reinforcement learning. We demonstrate ViNG on a number of real-world applications, such as last-mile delivery and warehouse inspection.
  arXiv  Detail & Related papers  (2020-12-17T18:22:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.