Vizarel: A System to Help Better Understand RL Agents

• URL: http://arxiv.org/abs/2007.05577v1
• Date: Fri, 10 Jul 2020 19:19:22 GMT
• Title: Vizarel: A System to Help Better Understand RL Agents
• Authors: Shuby Deshpande, Jeff Schneider
• Abstract summary: We describe our initial attempt at constructing a prototype of these ideas. Our design is motivated by envisioning the system to be a platform on which to experiment with interpretable reinforcement learning.
• Score: 4.009038499050246
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Visualization tools for supervised learning have allowed users to interpret, introspect, and gain intuition for the successes and failures of their models. While reinforcement learning practitioners ask many of the same questions, existing tools are not applicable to the RL setting. In this work, we describe our initial attempt at constructing a prototype of these ideas, through identifying possible features that such a system should encapsulate. Our design is motivated by envisioning the system to be a platform on which to experiment with interpretable reinforcement learning.

Related papers

• Game On: Towards Language Models as RL Experimenters [8.131696370980379]
  We propose an agent architecture that automates parts of the common reinforcement learning experiment workflow. We use a standard Gemini model, without additional fine-tuning, to provide a curriculum of skills to a language-conditioned Actor-Critic algorithm. Additional examination of the ability of the system to build a growing library of skills, and to judge the progress of the training of those skills, also shows promising results.
  arXiv  Detail & Related papers  (2024-09-05T10:38:16Z)
• CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update [69.59482029810198]
  CLOVA is a Closed-Loop Visual Assistant that operates within a framework encompassing inference, reflection, and learning phases. Results demonstrate that CLOVA surpasses existing tool-usage methods by 5% in visual question answering and multiple-image reasoning, by 10% in knowledge tagging, and by 20% in image editing.
  arXiv  Detail & Related papers  (2023-12-18T03:34:07Z)
• Tool Learning with Foundation Models [158.8640687353623]
  With the advent of foundation models, AI systems have the potential to be equally adept in tool use as humans. Despite its immense potential, there is still a lack of a comprehensive understanding of key challenges, opportunities, and future endeavors in this field.
  arXiv  Detail & Related papers  (2023-04-17T15:16:10Z)
• Accelerating exploration and representation learning with offline pre-training [52.6912479800592]
  We show that exploration and representation learning can be improved by separately learning two different models from a single offline dataset. We show that learning a state representation using noise-contrastive estimation and a model of auxiliary reward can significantly improve the sample efficiency on the challenging NetHack benchmark.
  arXiv  Detail & Related papers  (2023-03-31T18:03:30Z)
• Redefining Counterfactual Explanations for Reinforcement Learning: Overview, Challenges and Opportunities [2.0341936392563063]
  Most explanation methods for AI are focused on developers and expert users. Counterfactual explanations offer users advice on what can be changed in the input for the output of the black-box model to change. Counterfactuals are user-friendly and provide actionable advice for achieving the desired output from the AI system.
  arXiv  Detail & Related papers  (2022-10-21T09:50:53Z)
• Learning from Ambiguous Demonstrations with Self-Explanation Guided Reinforcement Learning [20.263419567168388]
  Our work aims at efficiently leveraging ambiguous demonstrations for the training of a reinforcement learning (RL) agent. Inspired by how humans handle such situations, we propose to use self-explanation to recognize valuable high-level relational features. Our main contribution is to propose the Self-Explanation for RL from Demonstrations (SERLfD) framework, which can overcome the limitations of traditional RLfD works.
  arXiv  Detail & Related papers  (2021-10-11T13:59:48Z)
• Reinforcement Learning with Prototypical Representations [114.35801511501639]
  Proto-RL is a self-supervised framework that ties representation learning with exploration through prototypical representations. These prototypes simultaneously serve as a summarization of the exploratory experience of an agent as well as a basis for representing observations. This enables state-of-the-art downstream policy learning on a set of difficult continuous control tasks.
  arXiv  Detail & Related papers  (2021-02-22T18:56:34Z)
• Explainability Case Studies [2.2872132127037963]
  Explainability is one of the key ethical concepts in the design of AI systems. We present a set of case studies of a hypothetical AI-enabled product, which serves as a pedagogical tool to empower product designers, developers, students, and educators to develop a holistic explainability strategy for their own products.
  arXiv  Detail & Related papers  (2020-09-01T05:54:15Z)
• Explainable Recommender Systems via Resolving Learning Representations [57.24565012731325]
  Explanations could help improve user experience and discover system defects. We propose a novel explainable recommendation model through improving the transparency of the representation learning process.
  arXiv  Detail & Related papers  (2020-08-21T05:30:48Z)
• Interactive Visualization for Debugging RL [11.6341132172284]
  Our system addresses many features missing from previous tools such as tools for supervised learning often are not interactive. We provide an example workflow of how this system could be used, along with ideas for future extensions.
  arXiv  Detail & Related papers  (2020-08-14T15:28:18Z)
• Self-supervised Learning from a Multi-view Perspective [121.63655399591681]
  We show that self-supervised representations can extract task-relevant information and discard task-irrelevant information. Our theoretical framework paves the way to a larger space of self-supervised learning objective design.
  arXiv  Detail & Related papers  (2020-06-10T00:21:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.