ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement

• URL: http://arxiv.org/abs/2605.29302v1
• Date: Thu, 28 May 2026 03:33:07 GMT
• Title: ViASNet: A Video Ad Saliency Network for Predicting Dynamic Saliency and Viewer Engagement
• Abstract summary: This study focuses on deep saliency prediction for short-form video advertising.<n>Deep saliency models have been used to generate predictions of human eye fixation patterns.<n>We develop and test a new deep dynamic saliency prediction model called ViASNet.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The digital media landscape has seen a pervasive shift toward short-form video advertising on TV, social media and e-commerce platforms. The present study focuses on deep saliency prediction for short-form video advertising. Deep saliency models have been used to generate predictions of human eye fixation patterns with the purpose of enhancing user interaction with digital technology and optimizing its design. For video ads, dynamic saliency maps capture where and when viewers are looking, revealing why video ads are effective, and how their content should be optimized. We develop and test a new deep dynamic saliency prediction model called ViASNet (Video Ad Saliency Network), which has an architecture founded on the 3D U-Net, and accommodates the influence of audio and the semantic meaning of scenes. We assess the model's performance on 151 video ads, each seen by about 20 viewers wile their eye movements were tracked, and explore the critical factors influencing model performance through ablation experiments. We calculate the entropy of the predicted saliency maps frame-by-frame as a diagnostic tool to identify ads and scenes that fail to engage viewers, and illustrate its use on test data of 15 unseen ads. Our study reveals that ad design and testing can be sped up considerably through automated systems built on deep saliency models such as ViASNet.

Related papers

• Building a Precise Video Language with Human-AI Oversight [63.57293532815199]
  CHAI (Critique-based Human-AI Oversight) is a framework where trained experts critique and revise model-language pre-captions into improved post-captions.<n>Our ablations show that critique quality in precision, recall, and constructiveness, ensured by our oversight framework, directly governs downstream performance.
  arXiv  Detail & Related papers  (2026-04-22T09:01:04Z)
• NextAds: Towards Next-generation Personalized Video Advertising [46.666292153282875]
  NextAds is a generation-based paradigm for next-generation personalized video advertising.<n>We formulate two representative tasks: personalized creative generation and personalized creative integration.<n>We conduct initial exploratory experiments, demonstrating that GenAI can generate and integrate personalized creatives with encouraging performance.
  arXiv  Detail & Related papers  (2026-03-02T17:58:07Z)
• Decoding the Hook: A Multimodal LLM Framework for Analyzing the Hooking Period of Video Ads [9.34170961508317]
  Video ads are a vital medium for brands to engage consumers, with social media platforms leveraging user data to optimize ad delivery and boost engagement.<n>A crucial but under-explored aspect is the 'hooking period', the first three seconds that capture viewer attention and influence engagement metrics.<n>This study presents a framework using transformer-based multimodal large language models (MLLMs) to analyze the hooking period of video ads.
  arXiv  Detail & Related papers  (2026-02-25T18:24:06Z)
• Monitoring Viewer Attention During Online Ads [0.5499796332553706]
  Big brands gauge the liking and purchase intent of their new ads, by analyzing the facial responses of viewers recruited online to watch the ads from home or work.<n>Inattentive participants should get flagged and eliminated to avoid skewing the ad-testing process.<n>We introduce an architecture for monitoring viewer attention during online ads.
  arXiv  Detail & Related papers  (2025-04-08T17:34:02Z)
• ContextIQ: A Multimodal Expert-Based Video Retrieval System for Contextual Advertising [2.330164376631038]
  Contextual advertising serves ads that are aligned to the content that the user is viewing.<n>Current text-to-video retrieval models based on joint multimodal training demand large datasets and computational resources.<n>We introduce ContextIQ, a multimodal expert-based video retrieval system designed specifically for contextual advertising.
  arXiv  Detail & Related papers  (2024-10-29T17:01:05Z)
• Predicting Long-horizon Futures by Conditioning on Geometry and Time [49.86180975196375]
  We explore the task of generating future sensor observations conditioned on the past. We leverage the large-scale pretraining of image diffusion models which can handle multi-modality. We create a benchmark for video prediction on a diverse set of videos spanning indoor and outdoor scenes.
  arXiv  Detail & Related papers  (2024-04-17T16:56:31Z)
• Let's Think Frame by Frame with VIP: A Video Infilling and Prediction Dataset for Evaluating Video Chain-of-Thought [62.619076257298204]
  We motivate framing video reasoning as the sequential understanding of a small number of video reasonings. We introduce VIP, an inference-time challenge dataset designed to explore models' reasoning capabilities through video chain-of-thought. We benchmark GPT-4, GPT-3, and VICUNA on VIP, demonstrate the performance gap in complex video reasoning tasks, and encourage future work.
  arXiv  Detail & Related papers  (2023-05-23T10:26:42Z)
• A Multimodal Framework for Video Ads Understanding [64.70769354696019]
  We develop a multimodal system to improve the ability of structured analysis of advertising video content. Our solution achieved a score of 0.2470 measured in consideration of localization and prediction accuracy, ranking fourth in the 2021 TAAC final leaderboard.
  arXiv  Detail & Related papers  (2021-08-29T16:06:00Z)
• Learning to Predict Salient Faces: A Novel Visual-Audio Saliency Model [96.24038430433885]
  We propose a novel multi-modal video saliency model consisting of three branches: visual, audio and face. Experimental results show that the proposed method outperforms 11 state-of-the-art saliency prediction works.
  arXiv  Detail & Related papers  (2021-03-29T09:09:39Z)
• Predicting Online Video Advertising Effects with Multimodal Deep Learning [33.20913249848369]
  We propose a method for predicting the click through rate (CTR) of video advertisements and analyzing the factors that determine the CTR. In this paper, we demonstrate an optimized framework for accurately predicting the effects by taking advantage of the multimodal nature of online video advertisements.
  arXiv  Detail & Related papers  (2020-12-22T06:24:01Z)
• Poet: Product-oriented Video Captioner for E-commerce [124.9936946822493]
  In e-commerce, a growing number of user-generated videos are used for product promotion. How to generate video descriptions that narrate the user-preferred product characteristics depicted in the video is vital for successful promoting. We propose a product-oriented video captioner framework, abbreviated as Poet. We show that Poet achieves consistent performance improvement over previous methods concerning generation quality, product aspects capturing, and lexical diversity.
  arXiv  Detail & Related papers  (2020-08-16T10:53:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.