Joint sentiment analysis of lyrics and audio in music

• URL: http://arxiv.org/abs/2405.01988v1
• Date: Fri, 3 May 2024 10:42:17 GMT
• Title: Joint sentiment analysis of lyrics and audio in music
• Authors: Lea Schaab, Anna Kruspe,
• Abstract summary: In automatic analysis, the actual audio data is usually analyzed, but the lyrics can also play a crucial role in the perception of moods. We first evaluate various models for sentiment analysis based on lyrics and audio separately. The corresponding approaches already show satisfactory results, but they also exhibit weaknesses.
• Score: 1.2349562761400057
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Sentiment or mood can express themselves on various levels in music. In automatic analysis, the actual audio data is usually analyzed, but the lyrics can also play a crucial role in the perception of moods. We first evaluate various models for sentiment analysis based on lyrics and audio separately. The corresponding approaches already show satisfactory results, but they also exhibit weaknesses, the causes of which we examine in more detail. Furthermore, different approaches to combining the audio and lyrics results are proposed and evaluated. Considering both modalities generally leads to improved performance. We investigate misclassifications and (also intentional) contradictions between audio and lyrics sentiment more closely, and identify possible causes. Finally, we address fundamental problems in this research area, such as high subjectivity, lack of data, and inconsistency in emotion taxonomies.

Related papers

• You Shall Know a Tool by the Traces it Leaves: The Predictability of Sentiment Analysis Tools [74.98850427240464]
  We show that sentiment analysis tools disagree on the same dataset. We show that the sentiment tool used for sentiment annotation can even be predicted from its outcome.
  arXiv  Detail & Related papers  (2024-10-18T17:27:38Z)
• MeLFusion: Synthesizing Music from Image and Language Cues using Diffusion Models [57.47799823804519]
  We are inspired by how musicians compose music not just from a movie script, but also through visualizations. We propose MeLFusion, a model that can effectively use cues from a textual description and the corresponding image to synthesize music. Our exhaustive experimental evaluation suggests that adding visual information to the music synthesis pipeline significantly improves the quality of generated music.
  arXiv  Detail & Related papers  (2024-06-07T06:38:59Z)
• Exploring and Applying Audio-Based Sentiment Analysis in Music [0.0]
  The ability of a computational model to interpret musical emotions is largely unexplored. This study seeks to (1) predict the emotion of a musical clip over time and (2) determine the next emotion value after the music in a time series to ensure seamless transitions.
  arXiv  Detail & Related papers  (2024-02-22T22:34:06Z)
• Exploring the Emotional Landscape of Music: An Analysis of Valence Trends and Genre Variations in Spotify Music Data [0.0]
  This paper conducts an intricate analysis of musical emotions and trends using Spotify music data. Employing regression modeling, temporal analysis, mood transitions, and genre investigation, the study uncovers patterns within music-emotion relationships.
  arXiv  Detail & Related papers  (2023-10-29T15:57:31Z)
• Multimodal Lyrics-Rhythm Matching [0.0]
  We propose a novel multimodal lyrics-rhythm matching approach that specifically matches key components of lyrics and music with each other. We use audio instead of sheet music with readily available metadata, which creates more challenges yet increases the application flexibility of our method. Our experimental results reveal an 0.81 probability of matching on average, and around 30% of the songs have a probability of 0.9 or higher of keywords landing on strong beats.
  arXiv  Detail & Related papers  (2023-01-06T22:24:53Z)
• Affective Idiosyncratic Responses to Music [63.969810774018775]
  We develop methods to measure affective responses to music from over 403M listener comments on a Chinese social music platform. We test for musical, lyrical, contextual, demographic, and mental health effects that drive listener affective responses.
  arXiv  Detail & Related papers  (2022-10-17T19:57:46Z)
• Song Emotion Recognition: a Performance Comparison Between Audio Features and Artificial Neural Networks [0.0]
  We study the most common features and models used to tackle this problem, revealing which ones are best suited for recognizing emotion in a cappella songs. In this paper, we studied the most common features and models used in recent publications to tackle this problem, revealing which ones are best suited for recognizing emotion in a cappella songs.
  arXiv  Detail & Related papers  (2022-09-24T16:13:25Z)
• Causal Intervention Improves Implicit Sentiment Analysis [67.43379729099121]
  We propose a causal intervention model for Implicit Sentiment Analysis using Instrumental Variable (ISAIV) We first review sentiment analysis from a causal perspective and analyze the confounders existing in this task. Then, we introduce an instrumental variable to eliminate the confounding causal effects, thus extracting the pure causal effect between sentence and sentiment.
  arXiv  Detail & Related papers  (2022-08-19T13:17:57Z)
• Predicting emotion from music videos: exploring the relative contribution of visual and auditory information to affective responses [0.0]
  We present MusicVideos (MuVi), a novel dataset for affective multimedia content analysis. The data were collected by presenting music videos to participants in three conditions: music, visual, and audiovisual.
  arXiv  Detail & Related papers  (2022-02-19T07:36:43Z)
• Affective Image Content Analysis: Two Decades Review and New Perspectives [132.889649256384]
  We will comprehensively review the development of affective image content analysis (AICA) in the recent two decades. We will focus on the state-of-the-art methods with respect to three main challenges -- the affective gap, perception subjectivity, and label noise and absence. We discuss some challenges and promising research directions in the future, such as image content and context understanding, group emotion clustering, and viewer-image interaction.
  arXiv  Detail & Related papers  (2021-06-30T15:20:56Z)
• A Deep Neural Framework for Contextual Affect Detection [51.378225388679425]
  A short and simple text carrying no emotion can represent some strong emotions when reading along with its context. We propose a Contextual Affect Detection framework which learns the inter-dependence of words in a sentence.
  arXiv  Detail & Related papers  (2020-01-28T05:03:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.