Predicting human decision making in psychological tasks with recurrent neural networks

• URL: http://arxiv.org/abs/2010.11413v3
• Date: Wed, 20 Apr 2022 16:28:20 GMT
• Title: Predicting human decision making in psychological tasks with recurrent neural networks
• Authors: Baihan Lin, Djallel Bouneffouf, Guillermo Cecchi
• Abstract summary: We propose here to use a recurrent neural network architecture based on long short-term memory networks (LSTM) to predict the time series of the actions taken by human subjects engaged in gaming activity. In this study, we collate the human data from 8 published literature of the Iterated Prisoner's Dilemma comprising 168,386 individual decisions and post-process them into 8,257 behavioral trajectories of 9 actions each for both players. We demonstrate a clear advantage over the state-of-the-art methods in predicting human decision-making trajectories in both the single-agent scenario of the Iowa Gambling Task and the multi
• Score: 27.80555922579736
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Unlike traditional time series, the action sequences of human decision making usually involve many cognitive processes such as beliefs, desires, intentions, and theory of mind, i.e., what others are thinking. This makes predicting human decision-making challenging to be treated agnostically to the underlying psychological mechanisms. We propose here to use a recurrent neural network architecture based on long short-term memory networks (LSTM) to predict the time series of the actions taken by human subjects engaged in gaming activity, the first application of such methods in this research domain. In this study, we collate the human data from 8 published literature of the Iterated Prisoner's Dilemma comprising 168,386 individual decisions and post-process them into 8,257 behavioral trajectories of 9 actions each for both players. Similarly, we collate 617 trajectories of 95 actions from 10 different published studies of Iowa Gambling Task experiments with healthy human subjects. We train our prediction networks on the behavioral data and demonstrate a clear advantage over the state-of-the-art methods in predicting human decision-making trajectories in both the single-agent scenario of the Iowa Gambling Task and the multi-agent scenario of the Iterated Prisoner's Dilemma. Moreover, we observe that the weights of the LSTM networks modeling the top performers tend to have a wider distribution compared to poor performers, as well as a larger bias, which suggest possible interpretations for the distribution of strategies adopted by each group.

Related papers

• Capturing the Complexity of Human Strategic Decision-Making with Machine Learning [4.308322597847064]
  We conduct the largest study to date of strategic decision-making in the context of initial play in two-player matrix games. We show that a deep neural network trained on these data predicts people's choices better than leading theories of strategic behavior.
  arXiv  Detail & Related papers  (2024-08-15T00:39:42Z)
• Towards Neural Network based Cognitive Models of Dynamic Decision-Making by Humans [16.72938921687168]
  We build on Instance Based Learning (IBL) that posits that human decisions are based on similar situations encountered in the past. We propose two new attention-based neural network models to have open form non-linear functions to model distinct and heterogeneous human decision-making.
  arXiv  Detail & Related papers  (2024-07-24T20:28:03Z)
• A Neuro-Symbolic Approach for Enhanced Human Motion Prediction [5.742409080817885]
  We propose a neuro-symbolic approach for human motion prediction (NeuroSyM) NeuroSyM weights differently the interactions in the neighbourhood by leveraging an intuitive technique for spatial representation called qualitative Trajectory Calculus (QTC) Experimental results show that the NeuroSyM approach outperforms in most cases the baseline architectures in terms of prediction accuracy.
  arXiv  Detail & Related papers  (2023-04-23T20:11:40Z)
• Learning signatures of decision making from many individuals playing the same game [54.33783158658077]
  We design a predictive framework that learns representations to encode an individual's 'behavioral style' We apply our method to a large-scale behavioral dataset from 1,000 humans playing a 3-armed bandit task.
  arXiv  Detail & Related papers  (2023-02-21T21:41:53Z)
• Learning Theory of Mind via Dynamic Traits Attribution [59.9781556714202]
  We propose a new neural ToM architecture that learns to generate a latent trait vector of an actor from the past trajectories. This trait vector then multiplicatively modulates the prediction mechanism via a fast weights' scheme in the prediction neural network. We empirically show that the fast weights provide a good inductive bias to model the character traits of agents and hence improves mindreading ability.
  arXiv  Detail & Related papers  (2022-04-17T11:21:18Z)
• The world seems different in a social context: a neural network analysis of human experimental data [57.729312306803955]
  We show that it is possible to replicate human behavioral data in both individual and social task settings by modifying the precision of prior and sensory signals. An analysis of the neural activation traces of the trained networks provides evidence that information is coded in fundamentally different ways in the network in the individual and in the social conditions.
  arXiv  Detail & Related papers  (2022-03-03T17:19:12Z)
• Probabilistic Human Motion Prediction via A Bayesian Neural Network [71.16277790708529]
  We propose a probabilistic model for human motion prediction in this paper. Our model could generate several future motions when given an observed motion sequence. We extensively validate our approach on a large scale benchmark dataset Human3.6m.
  arXiv  Detail & Related papers  (2021-07-14T09:05:33Z)
• Interpretable Social Anchors for Human Trajectory Forecasting in Crowds [84.20437268671733]
  We propose a neural network-based system to predict human trajectory in crowds. We learn interpretable rule-based intents, and then utilise the expressibility of neural networks to model scene-specific residual. Our architecture is tested on the interaction-centric benchmark TrajNet++.
  arXiv  Detail & Related papers  (2021-05-07T09:22:34Z)
• Adversarial Refinement Network for Human Motion Prediction [61.50462663314644]
  Two popular methods, recurrent neural networks and feed-forward deep networks, are able to predict rough motion trend. We propose an Adversarial Refinement Network (ARNet) following a simple yet effective coarse-to-fine mechanism with novel adversarial error augmentation.
  arXiv  Detail & Related papers  (2020-11-23T05:42:20Z)
• Online Learning in Iterated Prisoner's Dilemma to Mimic Human Behavior [27.80555922579736]
  We study the behaviors of online learning algorithms in the Iterated Prisoner's Dilemma (IPD) game. We evaluate them based on a tournament of iterated prisoner's dilemma where multiple agents can compete in a sequential fashion. Results suggest that considering the current situation to make decision is the worst in this kind of social dilemma game.
  arXiv  Detail & Related papers  (2020-06-09T15:58:32Z)
• Unified Models of Human Behavioral Agents in Bandits, Contextual Bandits and RL [28.38826379640553]
  We propose a more general and flexible parametric framework for sequential decision making. Inspired by the known reward processing abnormalities of many mental disorders, our clinically-inspired agents demonstrated interesting behavioral trajectories.
  arXiv  Detail & Related papers  (2020-05-10T01:43:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.