Demystifying Visual Features of Movie Posters for Multi-Label Genre Identification

• URL: http://arxiv.org/abs/2309.12022v2
• Date: Sat, 12 Oct 2024 15:49:09 GMT
• Title: Demystifying Visual Features of Movie Posters for Multi-Label Genre Identification
• Authors: Utsav Kumar Nareti, Chandranath Adak, Soumi Chattopadhyay,
• Abstract summary: We present a deep transformer network with a probabilistic module to identify the movie genres exclusively from the poster. For experiments, we procured 13882 posters of 13 genres from the Internet Movie Database (IMDb), where our model performances were encouraging.
• Score: 0.35998666903987897
• License:
• Abstract: In the film industry, movie posters have been an essential part of advertising and marketing for many decades, and continue to play a vital role even today in the form of digital posters through online, social media and OTT (over-the-top) platforms. Typically, movie posters can effectively promote and communicate the essence of a film, such as its genre, visual style/tone, vibe and storyline cue/theme, which are essential to attract potential viewers. Identifying the genres of a movie often has significant practical applications in recommending the film to target audiences. Previous studies on genre identification have primarily focused on sources such as plot synopses, subtitles, metadata, movie scenes, and trailer videos; however, posters precede the availability of these sources, and provide pre-release implicit information to generate mass interest. In this paper, we work for automated multi-label movie genre identification only from poster images, without any aid of additional textual/metadata/video information about movies, which is one of the earliest attempts of its kind. Here, we present a deep transformer network with a probabilistic module to identify the movie genres exclusively from the poster. For experiments, we procured 13882 number of posters of 13 genres from the Internet Movie Database (IMDb), where our model performances were encouraging and even outperformed some major contemporary architectures.

Related papers

• MPDS: A Movie Posters Dataset for Image Generation with Diffusion Model [26.361736240401594]
  Movie posters are vital for captivating audiences, conveying themes, and driving market competition in the film industry. Despite exciting progress in image generation, current models often fall short in producing satisfactory poster results. We propose a Movie Posters DataSet (MPDS), tailored for text-to-image generation models to revolutionize poster production.
  arXiv  Detail & Related papers  (2024-10-22T09:20:03Z)
• Unraveling Movie Genres through Cross-Attention Fusion of Bi-Modal Synergy of Poster [13.28948224096886]
  Movie genre classification plays a pivotal role in film marketing, audience engagement, and recommendation systems. Previous explorations into movie genre classification have been mostly examined in plot summaries, subtitles, trailers and movie scenes. We present the framework that exploits movie posters from a visual and textual perspective to address the multilabel movie genre classification problem.
  arXiv  Detail & Related papers  (2024-10-12T16:14:18Z)
• MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence [62.72540590546812]
  MovieDreamer is a novel hierarchical framework that integrates the strengths of autoregressive models with diffusion-based rendering. We present experiments across various movie genres, demonstrating that our approach achieves superior visual and narrative quality.
  arXiv  Detail & Related papers  (2024-07-23T17:17:05Z)
• Movie101v2: Improved Movie Narration Benchmark [53.54176725112229]
  Automatic movie narration aims to generate video-aligned plot descriptions to assist visually impaired audiences. We introduce Movie101v2, a large-scale, bilingual dataset with enhanced data quality specifically designed for movie narration. Based on our new benchmark, we baseline a range of large vision-language models, including GPT-4V, and conduct an in-depth analysis of the challenges in narration generation.
  arXiv  Detail & Related papers  (2024-04-20T13:15:27Z)
• Beyond Labels: Leveraging Deep Learning and LLMs for Content Metadata [1.6574413179773761]
  Analyzing the metadata can help understand the user preferences to generate personalized recommendations and item cold starting. We present some of the challenges associated with using genre label information and propose a new way of examining the genre information. The Genre Spectrum helps capture the various nuanced genres in a title and our offline and online experiments corroborate the effectiveness of the approach.
  arXiv  Detail & Related papers  (2023-09-15T22:11:29Z)
• Film Trailer Generation via Task Decomposition [65.16768855902268]
  We model movies as graphs, where nodes are shots and edges denote semantic relations between them. We learn these relations using joint contrastive training which leverages privileged textual information from screenplays. An unsupervised algorithm then traverses the graph and generates trailers that human judges prefer to ones generated by competitive supervised approaches.
  arXiv  Detail & Related papers  (2021-11-16T20:50:52Z)
• Multilevel profiling of situation and dialogue-based deep networks for movie genre classification using movie trailers [7.904790547594697]
  We propose a novel multi-modality: situation, dialogue, and metadata-based movie genre classification framework. We develop the English movie trailer dataset (EMTD), which contains 2000 Hollywood movie trailers belonging to five popular genres.
  arXiv  Detail & Related papers  (2021-09-14T07:33:56Z)
• Political Posters Identification with Appearance-Text Fusion [49.55696202606098]
  We propose a method that efficiently utilizes appearance features and text vectors to accurately classify political posters. The majority of this work focuses on political posters that are designed to serve as a promotion of a certain political event.
  arXiv  Detail & Related papers  (2020-12-19T16:14:51Z)
• Movie Summarization via Sparse Graph Construction [65.16768855902268]
  We propose a model that identifies TP scenes by building a sparse movie graph that represents relations between scenes and is constructed using multimodal information. According to human judges, the summaries created by our approach are more informative and complete, and receive higher ratings, than the outputs of sequence-based models and general-purpose summarization algorithms.
  arXiv  Detail & Related papers  (2020-12-14T13:54:34Z)
• Rethinking movie genre classification with fine-grained semantic clustering [5.54966601302758]
  We find large semantic variations between movies within a single genre definition. We expand these 'coarse' genre labels by identifying 'fine-grained' semantic information. Our approach is demonstrated on a newly introduced multi-modal 37,866,450 frame, 8,800 movie trailer dataset.
  arXiv  Detail & Related papers  (2020-12-04T14:58:31Z)
• A Unified Framework for Shot Type Classification Based on Subject Centric Lens [89.26211834443558]
  We propose a learning framework for shot type recognition using Subject Guidance Network (SGNet) SGNet separates the subject and background of a shot into two streams, serving as separate guidance maps for scale and movement type classification respectively. We build a large-scale dataset MovieShots, which contains 46K shots from 7K movie trailers with annotations of their scale and movement types.
  arXiv  Detail & Related papers  (2020-08-08T15:49:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.