Integrating Multi-view Analysis: Multi-view Mixture-of-Expert for Textual Personality Detection

• URL: http://arxiv.org/abs/2408.08551v1
• Date: Fri, 16 Aug 2024 06:35:31 GMT
• Title: Integrating Multi-view Analysis: Multi-view Mixture-of-Expert for Textual Personality Detection
• Abstract summary: Textual personality detection aims to identify personality traits by analyzing user-generated content. Previous studies have struggled with automatically extracting and effectively integrating information from multiple perspectives. We propose the Multi-view Mixture-of-Experts Model for Textual Personality Detection (MvP)
• Score: 17.9947364868881
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Textual personality detection aims to identify personality traits by analyzing user-generated content. To achieve this effectively, it is essential to thoroughly examine user-generated content from various perspectives. However, previous studies have struggled with automatically extracting and effectively integrating information from multiple perspectives, thereby limiting their performance on personality detection. To address these challenges, we propose the Multi-view Mixture-of-Experts Model for Textual Personality Detection (MvP). MvP introduces a Multi-view Mixture-of-Experts (MoE) network to automatically analyze user posts from various perspectives. Additionally, it employs User Consistency Regularization to mitigate conflicts among different perspectives and learn a multi-view generic user representation. The model's training is optimized via a multi-task joint learning strategy that balances supervised personality detection with self-supervised user consistency constraints. Experimental results on two widely-used personality detection datasets demonstrate the effectiveness of the MvP model and the benefits of automatically analyzing user posts from diverse perspectives for textual personality detection.

Related papers

• Drift-Aware Multimodal User Representation Learning via Multi-Scale Temporal Modeling and Sparse Mixture-of-Experts [8.624467983444255]
  We propose DUMoE, a unified framework for drift-aware multimodal user representation learning.<n>Our model consists of (i) a temporal dynamics-aware backbone that captures and integrates static profiles, short-term behavioral signals, and long-term dependencies into a coherent representation, and (ii) a sparse mixture-of-experts (MoE) interest adapter that disentangles multiple latent interests via expert specialization and adaptive routing.<n>Experiments on real-world social media datasets show that DUMoE consistently outperforms state-of-the-art methods on both user interest prediction and interaction prediction tasks.
  arXiv  Detail & Related papers  (2026-08-26T13:15:17Z)
• Personal Visual Context Learning in Large Multimodal Models [53.33351452841322]
  We present Personal Visual Context Learning (Personal ), the prompt-time capability of using user-specific visual context to resolve personalized queries.<n>Our analysis of LMMs identifies a profound context utilization gap, revealing that the mechanisms for leveraging visual evidence, as well as aggregating multiple visual observations, remain critically understudied.<n>Motivated by these findings, we propose the Agentic Context Bank, a strong-time baseline that structures a user's visual context into a self-refining memory bank and employs query-adaptive evidence selection.
  arXiv  Detail & Related papers  (2026-05-11T17:59:17Z)
• Towards Customized Multimodal Role-Play [50.72454102691162]
  multimodal understanding and generation models enable richer human-AI interaction.<n>Yet jointly customizing a character's persona, dialogue style, and visual identity while maintaining output consistency across modalities remains largely unexplored.<n>We construct the RoleScape-20 dataset comprising 20 characters, including training and evaluation data that cover persona, stylistic descriptions, visual/expressive cues, and text-image interactions.<n>We devise UniCharacter, a two-stage training framework containing Unified Supervised Finetuning (Unified-SFT) and character-specific group relative policy optimization (Character-GRPO). Given only 10 images plus corresponding interaction examples, the model acquires the
  arXiv  Detail & Related papers  (2026-05-01T03:22:04Z)
• LLM-Driven Dual-Level Multi-Interest Modeling for Recommendation [12.89199121698673]
  Large language models (LLMs) show significant potential for multi-interest analysis due to their extensive knowledge and powerful reasoning capabilities.<n>We propose an LLM-driven dual-level multi-interest modeling framework for more effective recommendation.<n> Experiments on real-world datasets show the superiority of our approach against state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-07-15T02:13:54Z)
• MAP: Multi-user Personalization with Collaborative LLM-powered Agents [11.027068698393027]
  We introduce a user-centered workflow for multi-user personalization comprising three stages: Reflection, Analysis, and Feedback. MAP -- a textbfMulti-textbfAgent system for multi-user textbfPersonalization -- to operationalize this workflow. Our user study findings highlight MAP's effectiveness and usability for conflict resolution while emphasizing the importance of user involvement in resolution verification and failure management.
  arXiv  Detail & Related papers  (2025-03-17T02:52:10Z)
• InterChat: Enhancing Generative Visual Analytics using Multimodal Interactions [22.007942964950217]
  We develop InterChat, a generative visual analytics system that combines direct manipulation of visual elements with natural language inputs. This integration enables precise intent communication and supports progressive, visually driven exploratory data analyses.
  arXiv  Detail & Related papers  (2025-03-06T05:35:19Z)
• Multi-Faceted Multimodal Monosemanticity [42.64636740703632]
  We take a data-driven approach to analyze interpretable, monosemantic features extracted from deep multimodal models.<n>Specifically, we investigate CLIP, a prominent visual-language representation model trained on massive image-text pairs.<n>We develop a set of multi-modal interpretability tools and measures designed to disentangle and analyze features learned from CLIP.
  arXiv  Detail & Related papers  (2025-02-16T14:51:07Z)
• Towards Unified Multi-granularity Text Detection with Interactive Attention [56.79437272168507]
  "Detect Any Text" is an advanced paradigm that unifies scene text detection, layout analysis, and document page detection into a cohesive, end-to-end model. A pivotal innovation in DAT is the across-granularity interactive attention module, which significantly enhances the representation learning of text instances. Tests demonstrate that DAT achieves state-of-the-art performances across a variety of text-related benchmarks.
  arXiv  Detail & Related papers  (2024-05-30T07:25:23Z)
• AdaFPP: Adapt-Focused Bi-Propagating Prototype Learning for Panoramic Activity Recognition [51.24321348668037]
  Panoramic Activity Recognition (PAR) aims to identify multi-granularity behaviors performed by multiple persons in panoramic scenes. Previous methods rely on manually annotated detection boxes in training and inference, hindering further practical deployment. We propose a novel Adapt-Focused bi-Propagating Prototype learning (AdaFPP) framework to jointly recognize individual, group, and global activities in panoramic activity scenes.
  arXiv  Detail & Related papers  (2024-05-04T01:53:22Z)
• Enhancing HOI Detection with Contextual Cues from Large Vision-Language Models [56.257840490146]
  ConCue is a novel approach for improving visual feature extraction in HOI detection. We develop a transformer-based feature extraction module with a multi-tower architecture that integrates contextual cues into both instance and interaction detectors.
  arXiv  Detail & Related papers  (2023-11-26T09:11:32Z)
• What User Behaviors Make the Differences During the Process of Visual Analytics? [1.5285292154680246]
  This work presents a study on a comprehensive data collection of user behaviors, and our analysis approach with time-series classification methods. Our user study collects user behaviors on a diverse set of visualization tasks with two comparable systems, desktop and immersive visualizations. Our results reveal that user behaviors can be distinguished during the process of visual analytics and there is a potentially strong association between the physical behaviors of users and the visualization tasks they perform.
  arXiv  Detail & Related papers  (2023-11-01T17:45:52Z)
• Exploiting Modality-Specific Features For Multi-Modal Manipulation Detection And Grounding [54.49214267905562]
  We construct a transformer-based framework for multi-modal manipulation detection and grounding tasks. Our framework simultaneously explores modality-specific features while preserving the capability for multi-modal alignment. We propose an implicit manipulation query (IMQ) that adaptively aggregates global contextual cues within each modality.
  arXiv  Detail & Related papers  (2023-09-22T06:55:41Z)
• Domain-specific Learning of Multi-scale Facial Dynamics for Apparent Personality Traits Prediction [3.19935268158731]
  We propose a novel video-based automatic personality traits recognition approach. It consists of: (1) a textbfdomain-specific facial behavior modelling module that extracts personality-related multi-scale short-term human facial behavior features; (2) a textbflong-term behavior modelling module that summarizes all short-term features of a video as a long-term/video-level personality representation; and (3) a textbfmulti-task personality traits prediction module that models underlying relationship among all traits and jointly predict them based on the video-level personality representation.
  arXiv  Detail & Related papers  (2022-09-09T07:08:55Z)
• Uncertainty-Aware Multi-View Representation Learning [53.06828186507994]
  We devise a novel unsupervised multi-view learning approach, termed as Dynamic Uncertainty-Aware Networks (DUA-Nets) Guided by the uncertainty of data estimated from the generation perspective, intrinsic information from multiple views is integrated to obtain noise-free representations. Our model achieves superior performance in extensive experiments and shows the robustness to noisy data.
  arXiv  Detail & Related papers  (2022-01-15T07:16:20Z)
• MOPT: Multi-Object Panoptic Tracking [33.77171216778909]
  We introduce a novel perception task denoted as multi-object panoptic tracking (MOPT) MOPT allows for exploiting pixel-level semantic information of 'thing' and'stuff' classes, temporal coherence, and pixel-level associations over time. We present extensive quantitative and qualitative evaluations of both vision-based and LiDAR-based MOPT that demonstrate encouraging results.
  arXiv  Detail & Related papers  (2020-04-17T11:45:28Z)
• Exploit Clues from Views: Self-Supervised and Regularized Learning for Multiview Object Recognition [66.87417785210772]
  This work investigates the problem of multiview self-supervised learning (MV-SSL) A novel surrogate task for self-supervised learning is proposed by pursuing "object invariant" representation. Experiments shows that the recognition and retrieval results using view invariant prototype embedding (VISPE) outperform other self-supervised learning methods.
  arXiv  Detail & Related papers  (2020-03-28T07:06:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.