A Physical Quantum Agent

• URL: http://arxiv.org/abs/2007.04426v3
• Date: Tue, 2 Mar 2021 05:32:30 GMT
• Title: A Physical Quantum Agent
• Authors: Michael. J. Kewming, Sally Shrapnel, Gerard. J. Milburn
• Abstract summary: We present a simple optical agent that uses light to probe and learn components of its environment. In our scenario, the quantum agent probes the world using single photon pulses, where its classical counterpart uses a weak coherent state with an average photon number equal to one. We analyze the thermodynamic behavior of both agents, showing that improving the agent's estimate of the world corresponds to an increase in average work done on the sensor by the actuator pulse.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The concept of an embodied intelligent agent is a key concept in modern artificial intelligence and robotics. Physically, an agent is an open system embedded in an environment that it interacts with through sensors and actuators. It contains a learning algorithm that correlates the sensor and actuator results by learning features about its environment. In this article we present a simple optical agent that uses light to probe and learn components of its environment. In our scenario, the quantum agent outperforms a classical agent: The quantum agent probes the world using single photon pulses, where its classical counterpart uses a weak coherent state with an average photon number equal to one. We analyze the thermodynamic behavior of both agents, showing that improving the agent's estimate of the world corresponds to an increase in average work done on the sensor by the actuator pulse. Thus, our model provides a useful toy model for studying the interface between machine learning, optics, and statistical thermodynamics.

Related papers

• Rapid and Automated Alloy Design with Graph Neural Network-Powered LLM-Driven Multi-Agent Systems [0.0]
  A multi-agent AI model is used to automate the discovery of new metallic alloys. We focus on the NbMoTa family of body-centered cubic (bcc) alloys, modeled using an ML-based interatomic potential. By synergizing the predictive power of GNNs with the dynamic collaboration of LLM-based agents, the system autonomously navigates vast alloy design spaces.
  arXiv  Detail & Related papers  (2024-10-17T17:06:26Z)
• Agent AI: Surveying the Horizons of Multimodal Interaction [83.18367129924997]
  "Agent AI" is a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data. We envision a future where people can easily create any virtual reality or simulated scene and interact with agents embodied within the virtual environment.
  arXiv  Detail & Related papers  (2024-01-07T19:11:18Z)
• Neural-Logic Human-Object Interaction Detection [67.4993347702353]
  We present L OGIC HOI, a new HOI detector that leverages neural-logic reasoning and Transformer to infer feasible interactions between entities. Specifically, we modify the self-attention mechanism in vanilla Transformer, enabling it to reason over the human, action, object> triplet and constitute novel interactions. We formulate these two properties in first-order logic and ground them into continuous space to constrain the learning process of our approach, leading to improved performance and zero-shot generalization capabilities.
  arXiv  Detail & Related papers  (2023-11-16T11:47:53Z)
• Inferring Relational Potentials in Interacting Systems [56.498417950856904]
  We propose Neural Interaction Inference with Potentials (NIIP) as an alternative approach to discover such interactions. NIIP assigns low energy to the subset of trajectories which respect the relational constraints observed. It allows trajectory manipulation, such as interchanging interaction types across separately trained models, as well as trajectory forecasting.
  arXiv  Detail & Related papers  (2023-10-23T00:44:17Z)
• Incremental procedural and sensorimotor learning in cognitive humanoid robots [52.77024349608834]
  This work presents a cognitive agent that can learn procedures incrementally. We show the cognitive functions required in each substage and how adding new functions helps address tasks previously unsolved by the agent. Results show that this approach is capable of solving complex tasks incrementally.
  arXiv  Detail & Related papers  (2023-04-30T22:51:31Z)
• Active Predicting Coding: Brain-Inspired Reinforcement Learning for Sparse Reward Robotic Control Problems [79.07468367923619]
  We propose a backpropagation-free approach to robotic control through the neuro-cognitive computational framework of neural generative coding (NGC) We design an agent built completely from powerful predictive coding/processing circuits that facilitate dynamic, online learning from sparse rewards. We show that our proposed ActPC agent performs well in the face of sparse (extrinsic) reward signals and is competitive with or outperforms several powerful backprop-based RL approaches.
  arXiv  Detail & Related papers  (2022-09-19T16:49:32Z)
• Backprop-Free Reinforcement Learning with Active Neural Generative Coding [84.11376568625353]
  We propose a computational framework for learning action-driven generative models without backpropagation of errors (backprop) in dynamic environments. We develop an intelligent agent that operates even with sparse rewards, drawing inspiration from the cognitive theory of planning as inference. The robust performance of our agent offers promising evidence that a backprop-free approach for neural inference and learning can drive goal-directed behavior.
  arXiv  Detail & Related papers  (2021-07-10T19:02:27Z)
• QKSA: Quantum Knowledge Seeking Agent [0.0]
  We present the motivation and the core thesis towards the implementation of a Quantum Knowledge Seeking Agent (QKSA) QKSA is a general reinforcement learning agent that can be used to model classical and quantum dynamics.
  arXiv  Detail & Related papers  (2021-07-03T13:07:58Z)
• Experimental quantum speed-up in reinforcement learning agents [0.17849902073068336]
  reinforcement learning (RL) is an important paradigm within artificial intelligence (AI) We present a RL experiment where the learning of an agent is boosted by utilizing a quantum communication channel with the environment. We implement this learning protocol on a compact and fully tunable integrated nanophotonic processor.
  arXiv  Detail & Related papers  (2021-03-10T19:01:12Z)
• Multi-sensory Integration in a Quantum-Like Robot Perception Model [1.0957528713294875]
  Quantum-Like (QL) approaches provide descriptive features that are inherently suitable for perception, cognition, and decision processing. A preliminary study on the feasibility of a QL robot perception model has been carried out for a robot with limited sensing capabilities.
  arXiv  Detail & Related papers  (2020-06-29T21:47:33Z)
• Deep active inference agents using Monte-Carlo methods [3.8233569758620054]
  We present a neural architecture for building deep active inference agents in continuous state-spaces using Monte-Carlo sampling. Our approach enables agents to learn environmental dynamics efficiently, while maintaining task performance. Results show that deep active inference provides a flexible framework to develop biologically-inspired intelligent agents.
  arXiv  Detail & Related papers  (2020-06-07T15:10:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.