Using Interaction Data to Predict Engagement with Interactive Media
- URL: http://arxiv.org/abs/2108.01949v1
- Date: Wed, 4 Aug 2021 10:28:36 GMT
- Title: Using Interaction Data to Predict Engagement with Interactive Media
- Abstract summary: This paper reports a study using data captured from audience interactions with an interactive TV show to model and predict engagement.
We find that temporal metrics, including overall time spent on the experience and the interval between events, are predictive of engagement.
- Score: 8.35844047176969
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Media is evolving from traditional linear narratives to personalised
experiences, where control over information (or how it is presented) is given
to individual audience members. Measuring and understanding audience engagement
with this media is important in at least two ways: (1) a post-hoc understanding
of how engaged audiences are with the content will help production teams learn
from experience and improve future productions; (2), this type of media has
potential for real-time measures of engagement to be used to enhance the user
experience by adapting content on-the-fly. Engagement is typically measured by
asking samples of users to self-report, which is time consuming and expensive.
In some domains, however, interaction data have been used to infer engagement.
Fortuitously, the nature of interactive media facilitates a much richer set of
interaction data than traditional media; our research aims to understand if
these data can be used to infer audience engagement. In this paper, we report a
study using data captured from audience interactions with an interactive TV
show to model and predict engagement. We find that temporal metrics, including
overall time spent on the experience and the interval between events, are
predictive of engagement. The results demonstrate that interaction data can be
used to infer users' engagement during and after an experience, and the
proposed techniques are relevant to better understand audience preference and
responses.
Related papers
- The CAST-framework: Measure and model social media use as a multi-level phenomenon through real-world applications [1.48927186783029]
We introduce the CAST framework to connect measurement choices with person-specific models of exposure, behavior, physiology, and experience.<n>We propose four synchronized measurement modules linking mobile and wearable data with self-reports and intervention responses.<n>The framework guides selection of measures and outcomes for evaluating social media interfaces and interventions.
arXiv Detail & Related papers (2026-09-14T17:57:30Z) - VitaBench 2.0: Evaluating Personalized and Proactive Agents in Long-Term User Interactions [63.13827503828231]
We introduce VitaBench 2.0, a benchmark for evaluating personalized and proactive agent behavior in long-term user interactions.<n>Results show that real-world personalization remains highly challenging even for state-of-the-art models.
arXiv Detail & Related papers (2026-05-26T15:07:38Z) - PERMA: Benchmarking Personalized Memory Agents via Event-Driven Preference and Realistic Task Environments [72.02445514666428]
We introduce PERMA, a benchmark designed to evaluate persona consistency over time beyond static preference recall.<n>PerMA consists of temporally ordered interaction events spanning multiple sessions and domains, with preference-related queries inserted over time.<n> Experiments demonstrate that by linking related interactions, advanced memory systems can extract more precise preferences and reduce token consumption.
arXiv Detail & Related papers (2026-03-24T14:04:11Z) - Mind the Gap! Static and Interactive Evaluations of Large Audio Models [55.87220295533817]
Large Audio Models (LAMs) are designed to power voice-native experiences.
This study introduces an interactive approach to evaluate LAMs and collect 7,500 LAM interactions from 484 participants.
arXiv Detail & Related papers (2025-02-21T20:29:02Z) - InterFormer: Towards Effective Heterogeneous Interaction Learning for Click-Through Rate Prediction [72.50606292994341]
We propose a novel module named InterFormer to learn heterogeneous information interaction in an interleaving style.
Our proposed InterFormer achieves state-of-the-art performance on three public datasets and a large-scale industrial dataset.
arXiv Detail & Related papers (2024-11-15T00:20:36Z) - Unveiling the Impact of Multi-Modal Interactions on User Engagement: A Comprehensive Evaluation in AI-driven Conversations [17.409790984399052]
This paper explores the impact of multi-modal interactions, which incorporate images and audio alongside text, on user engagement.
Our findings reveal a significant enhancement in user engagement with multi-modal interactions compared to text-only dialogues.
Results suggest that multi-modal interactions optimize cognitive processing and facilitate richer information comprehension.
arXiv Detail & Related papers (2024-06-21T09:26:55Z) - AMMeBa: A Large-Scale Survey and Dataset of Media-Based Misinformation In-The-Wild [1.4193873432298625]
We show the results of a two-year study using human raters to annotate online media-based misinformation.
We show the rise of generative AI-based content in misinformation claims.
We also show "simple" methods dominated historically, particularly context manipulations.
arXiv Detail & Related papers (2024-05-19T23:05:53Z) - Organized Event Participant Prediction Enhanced by Social Media
Retweeting Data [8.675064911866201]
We propose to utilize social media retweeting activity data to enhance the learning of event participant prediction models.
We conduct comprehensive experiments in two scenarios with real-world data.
arXiv Detail & Related papers (2023-10-02T04:26:07Z) - Identification, Impacts, and Opportunities of Three Common Measurement
Considerations when using Digital Trace Data [2.1301560294088318]
Screenomics records media use at the granularity of individual screenshots obtained every few seconds as people interact with mobile devices.
We label the considerations as follows: (1) entangling summation - the common measurement error introduced by proxying exposure to content by exposure to format; (2) flattening - aggregating unique segments of media interaction without incorporating temporal information; and (3) bundling.
arXiv Detail & Related papers (2023-09-30T00:28:19Z) - Fair Effect Attribution in Parallel Online Experiments [57.13281584606437]
A/B tests serve the purpose of reliably identifying the effect of changes introduced in online services.
It is common for online platforms to run a large number of simultaneous experiments by splitting incoming user traffic randomly.
Despite a perfect randomization between different groups, simultaneous experiments can interact with each other and create a negative impact on average population outcomes.
arXiv Detail & Related papers (2022-10-15T17:15:51Z) - Understanding How People Rate Their Conversations [73.17730062864314]
We conduct a study to better understand how people rate their interactions with conversational agents.
We focus on agreeableness and extraversion as variables that may explain variation in ratings.
arXiv Detail & Related papers (2022-06-01T00:45:32Z) - User Interaction Analysis through Contrasting Websites Experience [4.14955672190455]
We perform the quantitative analysis the usability of websites based on their usage and relevance.
We do this by reporting user interactions based user subjective perceptions, eye-tracking data and facial expressions.
In general, we found that the user interaction parameters are substantially difference across website sets.
arXiv Detail & Related papers (2022-01-10T20:43:19Z) - Perceptual Score: What Data Modalities Does Your Model Perceive? [73.75255606437808]
We introduce the perceptual score, a metric that assesses the degree to which a model relies on the different subsets of the input features.
We find that recent, more accurate multi-modal models for visual question-answering tend to perceive the visual data less than their predecessors.
Using the perceptual score also helps to analyze model biases by decomposing the score into data subset contributions.
arXiv Detail & Related papers (2021-10-27T12:19:56Z) - Learning Modality Interaction for Temporal Sentence Localization and
Event Captioning in Videos [76.21297023629589]
We propose a novel method for learning pairwise modality interactions in order to better exploit complementary information for each pair of modalities in videos.
Our method turns out to achieve state-of-the-art performances on four standard benchmark datasets.
arXiv Detail & Related papers (2020-07-28T12:40:59Z) - Human Trajectory Forecasting in Crowds: A Deep Learning Perspective [89.4600982169]
We present an in-depth analysis of existing deep learning-based methods for modelling social interactions.
We propose two knowledge-based data-driven methods to effectively capture these social interactions.
We develop a large scale interaction-centric benchmark TrajNet++, a significant yet missing component in the field of human trajectory forecasting.
arXiv Detail & Related papers (2020-07-07T17:19:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.