BERTERS: Multimodal Representation Learning for Expert Recommendation System with Transformer

• URL: http://arxiv.org/abs/2007.07229v1
• Date: Tue, 30 Jun 2020 12:30:16 GMT
• Title: BERTERS: Multimodal Representation Learning for Expert Recommendation System with Transformer
• Authors: N. Nikzad-Khasmakhi, M. A. Balafar, M.Reza Feizi-Derakhshi, Cina Motamed
• Abstract summary: We introduce a multimodal classification approach for expert recommendation system (BERTERS) BERTERS converts text into a vector using the Bidirectional Representations from Transformer (BERT) Also, a graph Representation technique called ExEm is used to extract the features of candidates from the co-author network.
• Score: 2.131521514043068
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The objective of an expert recommendation system is to trace a set of candidates' expertise and preferences, recognize their expertise patterns, and identify experts. In this paper, we introduce a multimodal classification approach for expert recommendation system (BERTERS). In our proposed system, the modalities are derived from text (articles published by candidates) and graph (their co-author connections) information. BERTERS converts text into a vector using the Bidirectional Encoder Representations from Transformer (BERT). Also, a graph Representation technique called ExEm is used to extract the features of candidates from the co-author network. Final representation of a candidate is the concatenation of these vectors and other features. Eventually, a classifier is built on the concatenation of features. This multimodal approach can be used in both the academic community and the community question answering. To verify the effectiveness of BERTERS, we analyze its performance on multi-label classification and visualization tasks.

Related papers

• Multi-Type Context-Aware Conversational Recommender Systems via Mixture-of-Experts [51.73670879337781]
  We propose a multi-type context-aware conversational recommender system, called MCCRS, to improve conversational recommender systems. MCCRS incorporates both structured information and unstructured information, including the structured knowledge graph, unstructured conversation history, and unstructured item reviews. Our proposed MCCRS model takes advantage of different contextual information and the specialization of different experts followed by a ChairBot.
  arXiv  Detail & Related papers  (2025-04-18T12:28:38Z)
• Universal Item Tokenization for Transferable Generative Recommendation [89.42584009980676]
  We propose UTGRec, a universal item tokenization approach for transferable Generative Recommendation. By devising tree-structured codebooks, we discretize content representations into corresponding codes for item tokenization. For raw content reconstruction, we employ dual lightweight decoders to reconstruct item text and images from discrete representations. For collaborative knowledge integration, we assume that co-occurring items are similar and integrate collaborative signals through co-occurrence alignment and reconstruction.
  arXiv  Detail & Related papers  (2025-04-06T08:07:49Z)
• Generative Compositor for Few-Shot Visual Information Extraction [60.663887314625164]
  We propose a novel generative model, named Generative generative spatialtor, to address the challenge of few-shot VIE. Generative generative spatialtor is a hybrid pointer-generator network that emulates the operations of a compositor by retrieving words from the source text. The proposed method achieves highly competitive results in the full-sample training, while notably outperforms the baseline in the 1-shot, 5-shot, and 10-shot settings.
  arXiv  Detail & Related papers  (2025-03-21T04:56:24Z)
• Multimodal Pretraining and Generation for Recommendation: A Tutorial [54.07497722719509]
  The tutorial comprises three parts: multimodal pretraining, multimodal generation, and industrial applications. It aims to facilitate a swift understanding of multimodal recommendation and foster meaningful discussions on the future development of this evolving landscape.
  arXiv  Detail & Related papers  (2024-05-11T06:15:22Z)
• Disentangling Instructive Information from Ranked Multiple Candidates for Multi-Document Scientific Summarization [13.953968282622121]
  This paper introduces summary candidates into Multi-Document Scientific Summarization. It uses the global information of the document set and additional guidance from the summary candidates to guide the decoding process. We observe noticeable performance improvements according to automatic and human evaluation.
  arXiv  Detail & Related papers  (2024-04-16T09:33:07Z)
• Knowledge Graphs and Pre-trained Language Models enhanced Representation Learning for Conversational Recommender Systems [58.561904356651276]
  We introduce the Knowledge-Enhanced Entity Representation Learning (KERL) framework to improve the semantic understanding of entities for Conversational recommender systems. KERL uses a knowledge graph and a pre-trained language model to improve the semantic understanding of entities. KERL achieves state-of-the-art results in both recommendation and response generation tasks.
  arXiv  Detail & Related papers  (2023-12-18T06:41:23Z)
• Embedding in Recommender Systems: A Survey [67.67966158305603]
  A crucial aspect is embedding techniques that covert the high-dimensional discrete features, such as user and item IDs, into low-dimensional continuous vectors. Applying embedding techniques captures complex entity relationships and has spurred substantial research. This survey covers embedding methods like collaborative filtering, self-supervised learning, and graph-based techniques.
  arXiv  Detail & Related papers  (2023-10-28T06:31:06Z)
• Prompting ChatGPT in MNER: Enhanced Multimodal Named Entity Recognition with Auxiliary Refined Knowledge [27.152813529536424]
  We present PGIM -- a two-stage framework that aims to leverage ChatGPT as an implicit knowledge base. PGIM generates auxiliary knowledge for more efficient entity prediction. It outperforms state-of-the-art methods on two classic MNER datasets.
  arXiv  Detail & Related papers  (2023-05-20T15:24:38Z)
• METransformer: Radiology Report Generation by Transformer with Multiple Learnable Expert Tokens [43.817603311027646]
  We propose a method to upgrade the existing "single expert" framework with a transformer-based backbone. Key design of our method is the introduction of multiple learnable "expert" tokens into both the transformer encoder and decoder. A metrics-based expert voting strategy is further developed to generate the final report.
  arXiv  Detail & Related papers  (2023-04-05T03:54:28Z)
• Multi-Modal Recommendation System with Auxiliary Information [0.47267770920095536]
  This study extends the existing research by evaluating a multi-modal recommendation system that exploits the inclusion of comprehensive auxiliary knowledge related to an item. The analysis of the experimental results shows a statistically significant improvement in prediction accuracy, which confirms the effectiveness of including auxiliary information in a context-aware recommendation system.
  arXiv  Detail & Related papers  (2022-10-13T20:20:49Z)
• Knowledge Graph Augmented Network Towards Multiview Representation Learning for Aspect-based Sentiment Analysis [96.53859361560505]
  We propose a knowledge graph augmented network (KGAN) to incorporate external knowledge with explicitly syntactic and contextual information. KGAN captures the sentiment feature representations from multiple perspectives, i.e., context-, syntax- and knowledge-based. Experiments on three popular ABSA benchmarks demonstrate the effectiveness and robustness of our KGAN.
  arXiv  Detail & Related papers  (2022-01-13T08:25:53Z)
• Knowledge-Enhanced Hierarchical Graph Transformer Network for Multi-Behavior Recommendation [56.12499090935242]
  This work proposes a Knowledge-Enhanced Hierarchical Graph Transformer Network (KHGT) to investigate multi-typed interactive patterns between users and items in recommender systems. KHGT is built upon a graph-structured neural architecture to capture type-specific behavior characteristics. We show that KHGT consistently outperforms many state-of-the-art recommendation methods across various evaluation settings.
  arXiv  Detail & Related papers  (2021-10-08T09:44:00Z)
• Deep Learning feature selection to unhide demographic recommender systems factors [63.732639864601914]
  The matrix factorization model generates factors which do not incorporate semantic knowledge. DeepUnHide is able to extract demographic information from the users and items factors in collaborative filtering recommender systems.
  arXiv  Detail & Related papers  (2020-06-17T17:36:48Z)
• ExEm: Expert Embedding using dominating set theory with deep learning approaches [2.131521514043068]
  We propose a graph embedding method, called ExEm, that uses dominating-set theory and deep learning approaches to capture node representations. ExEm exploits three embedding methods including Word2vec, fastText and the concatenation of these two. The extracted expert embeddings can be applied to many applications.
  arXiv  Detail & Related papers  (2020-01-16T10:47:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.