Learning Efficient Representations of Mouse Movements to Predict User Attention

• URL: http://arxiv.org/abs/2006.01644v1
• Date: Sat, 30 May 2020 09:52:26 GMT
• Title: Learning Efficient Representations of Mouse Movements to Predict User Attention
• Authors: Ioannis Arapakis and Luis A. Leiva
• Abstract summary: We investigate different representations of mouse cursor movements, including time series, heatmaps, and trajectory-based images. We build and contrast both recurrent and convolutional neural networks that can predict user attention to direct displays. Our models are trained over raw mouse cursor data and achieve competitive performance.
• Score: 12.259552039796027
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Tracking mouse cursor movements can be used to predict user attention on heterogeneous page layouts like SERPs. So far, previous work has relied heavily on handcrafted features, which is a time-consuming approach that often requires domain expertise. We investigate different representations of mouse cursor movements, including time series, heatmaps, and trajectory-based images, to build and contrast both recurrent and convolutional neural networks that can predict user attention to direct displays, such as SERP advertisements. Our models are trained over raw mouse cursor data and achieve competitive performance. We conclude that neural network models should be adopted for downstream tasks involving mouse cursor movements, since they can provide an invaluable implicit feedback signal for re-ranking and evaluation.

Related papers

• DyG-Mamba: Continuous State Space Modeling on Dynamic Graphs [59.434893231950205]
  Dynamic graph learning aims to uncover evolutionary laws in real-world systems. We propose DyG-Mamba, a new continuous state space model for dynamic graph learning. We show that DyG-Mamba achieves state-of-the-art performance on most datasets.
  arXiv  Detail & Related papers  (2024-08-13T15:21:46Z)
• Modeling User Preferences via Brain-Computer Interfacing [54.3727087164445]
  We use Brain-Computer Interfacing technology to infer users' preferences, their attentional correlates towards visual content, and their associations with affective experience. We link these to relevant applications, such as information retrieval, personalized steering of generative models, and crowdsourcing population estimates of affective experiences.
  arXiv  Detail & Related papers  (2024-05-15T20:41:46Z)
• The Sensorium competition on predicting large-scale mouse primary visual cortex activity [28.272130531998936]
  We propose the Sensorium benchmark competition to identify state-of-the-art models of the mouse visual system. We collected a large-scale dataset from mouse primary visual cortex containing the responses of more than 28,000 neurons. The benchmark challenge will rank models based on predictive performance for neuronal responses on a held-out test set.
  arXiv  Detail & Related papers  (2022-06-17T10:09:57Z)
• SATBench: Benchmarking the speed-accuracy tradeoff in object recognition by humans and dynamic neural networks [0.45438205344305216]
  People show a flexible tradeoff between speed and accuracy. We present the first large-scale dataset of the speed-accuracy tradeoff (SAT) in recognizing ImageNet images. We compare networks with humans on curve-fit error, category-wise correlation, and curve steepness.
  arXiv  Detail & Related papers  (2022-06-16T20:03:31Z)
• Multi-level Motion Attention for Human Motion Prediction [132.29963836262394]
  We study the use of different types of attention, computed at joint, body part, and full pose levels. Our experiments on Human3.6M, AMASS and 3DPW validate the benefits of our approach for both periodical and non-periodical actions.
  arXiv  Detail & Related papers  (2021-06-17T08:08:11Z)
• From Hand-Perspective Visual Information to Grasp Type Probabilities: Deep Learning via Ranking Labels [6.772076545800592]
  We build a novel probabilistic classifier according to the Plackett-Luce model to predict the probability distribution over grasps. We indicate that the proposed model is applicable to the most popular and productive convolutional neural network frameworks.
  arXiv  Detail & Related papers  (2021-03-08T16:12:38Z)
• Query Abandonment Prediction with Recurrent Neural Models of Mouse Cursor Movements [10.088906689243768]
  We show that mouse cursor movements make a valuable, low-cost behavioral signal that can discriminate good and bad abandonment. Our results can help search providers to gauge user satisfaction for queries without clicks and ultimately contribute to a better understanding of search engine performance.
  arXiv  Detail & Related papers  (2021-01-22T11:57:04Z)
• Structured Context Enhancement Network for Mouse Pose Estimation [16.95848000851908]
  We propose a novel Hourglass network based model, namely Graphical Model based Structured Context Enhancement Network (GM-SCENet) SCM can adaptively learn and enhance the proposed structured context information of each mouse part by a novel graphical model. The CMLS module is designed to jointly train the proposed SCM and the Hourglass network by generating multi-level information.
  arXiv  Detail & Related papers  (2020-12-01T16:50:19Z)
• History Repeats Itself: Human Motion Prediction via Motion Attention [81.94175022575966]
  We introduce an attention-based feed-forward network that explicitly leverages the observation that human motion tends to repeat itself. In particular, we propose to extract motion attention to capture the similarity between the current motion context and the historical motion sub-sequences. Our experiments on Human3.6M, AMASS and 3DPW evidence the benefits of our approach for both periodical and non-periodical actions.
  arXiv  Detail & Related papers  (2020-07-23T02:12:27Z)
• BeCAPTCHA-Mouse: Synthetic Mouse Trajectories and Improved Bot Detection [78.11535724645702]
  We present BeCAPTCHA-Mouse, a bot detector based on a neuromotor model of mouse dynamics. BeCAPTCHA-Mouse is able to detect bot trajectories of high realism with 93% of accuracy in average using only one mouse trajectory.
  arXiv  Detail & Related papers  (2020-05-02T17:40:49Z)
• ArTIST: Autoregressive Trajectory Inpainting and Scoring for Tracking [80.02322563402758]
  One of the core components in online multiple object tracking (MOT) frameworks is associating new detections with existing tracklets. We introduce a probabilistic autoregressive generative model to score tracklet proposals by directly measuring the likelihood that a tracklet represents natural motion.
  arXiv  Detail & Related papers  (2020-04-16T06:43:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.