DeHate: A Stable Diffusion-based Multimodal Approach to Mitigate Hate Speech in Images

• URL: http://arxiv.org/abs/2509.21787v2
• Date: Fri, 10 Oct 2025 09:11:19 GMT
• Title: DeHate: A Stable Diffusion-based Multimodal Approach to Mitigate Hate Speech in Images
• Abstract summary: We introduce a multimodal dataset uniquely crafted for identifying hate in digital content.<n>We apply watermarked, stability-enhanced, stable diffusion techniques combined with the Digital Attention Analysis Module (DAAM)<n>This combination is instrumental in pinpointing the hateful elements within images, thereby generating detailed hate attention maps.<n>We present DeHater, a vision-language model designed for multimodal dehatification tasks.
• Score: 36.07539683072692
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The rise in harmful online content not only distorts public discourse but also poses significant challenges to maintaining a healthy digital environment. In response to this, we introduce a multimodal dataset uniquely crafted for identifying hate in digital content. Central to our methodology is the innovative application of watermarked, stability-enhanced, stable diffusion techniques combined with the Digital Attention Analysis Module (DAAM). This combination is instrumental in pinpointing the hateful elements within images, thereby generating detailed hate attention maps, which are used to blur these regions from the image, thereby removing the hateful sections of the image. We release this data set as a part of the dehate shared task. This paper also describes the details of the shared task. Furthermore, we present DeHater, a vision-language model designed for multimodal dehatification tasks. Our approach sets a new standard in AI-driven image hate detection given textual prompts, contributing to the development of more ethical AI applications in social media.

Related papers

• Safeguard Text-to-Image Diffusion Models with Human Feedback Inversion [51.931083971448885]
  We propose a framework named Human Feedback Inversion (HFI), where human feedback on model-generated images is condensed into textual tokens guiding the mitigation or removal of problematic images. Our experimental results demonstrate our framework significantly reduces objectionable content generation while preserving image quality, contributing to the ethical deployment of AI in the public sphere.
  arXiv  Detail & Related papers  (2024-07-17T05:21:41Z)
• Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generation [60.943159830780154]
  We introduce Bounded Attention, a training-free method for bounding the information flow in the sampling process. We demonstrate that our method empowers the generation of multiple subjects that better align with given prompts and layouts.
  arXiv  Detail & Related papers  (2024-03-25T17:52:07Z)
• Catch You Everything Everywhere: Guarding Textual Inversion via Concept Watermarking [67.60174799881597]
  We propose the novel concept watermarking, where watermark information is embedded into the target concept and then extracted from generated images based on the watermarked concept. In practice, the concept owner can upload his concept with different watermarks (ie, serial numbers) to the platform, and the platform allocates different users with different serial numbers for subsequent tracing and forensics.
  arXiv  Detail & Related papers  (2023-09-12T03:33:13Z)
• Towards Safe Self-Distillation of Internet-Scale Text-to-Image Diffusion Models [63.20512617502273]
  We propose a method called SDD to prevent problematic content generation in text-to-image diffusion models. Our method eliminates a much greater proportion of harmful content from the generated images without degrading the overall image quality.
  arXiv  Detail & Related papers  (2023-07-12T07:48:29Z)
• Deep Image Deblurring: A Survey [165.32391279761006]
  Deblurring is a classic problem in low-level computer vision, which aims to recover a sharp image from a blurred input image. Recent advances in deep learning have led to significant progress in solving this problem.
  arXiv  Detail & Related papers  (2022-01-26T01:31:30Z)
• A Compact Neural Network-based Algorithm for Robust Image Watermarking [30.727227627295548]
  We propose a novel digital image watermarking solution with a compact neural network, named Invertible Watermarking Network (IWN) Our IWN architecture is based on a single Invertible Neural Network (INN) In order to enhance the robustness of our watermarking solution, we specifically introduce a simple but effective bit message normalization module.
  arXiv  Detail & Related papers  (2021-12-27T03:20:45Z)
• Detecting Hate Speech in Multi-modal Memes [14.036769355498546]
  We focus on hate speech detection in multi-modal memes wherein memes pose an interesting multi-modal fusion problem. We aim to solve the Facebook Meme Challenge citekiela 2020hateful which aims to solve a binary classification problem of predicting whether a meme is hateful or not.
  arXiv  Detail & Related papers  (2020-12-29T18:30:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.