Labeled Interactive Topic Models
- URL: http://arxiv.org/abs/2311.09438v2
- Date: Wed, 7 Feb 2024 14:41:40 GMT
- Title: Labeled Interactive Topic Models
- Authors: Kyle Seelman, Mozhi Zhang, Jordan Boyd-Graber
- Abstract summary: We introduce a user-friendly interaction for neural topic models.
This interaction permits users to assign a word label to a topic.
We evaluate our method through a human study, where users can relabel topics to find relevant documents.
- Score: 10.555664965166232
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Topic models are valuable for understanding extensive document collections,
but they don't always identify the most relevant topics. Classical
probabilistic and anchor-based topic models offer interactive versions that
allow users to guide the models towards more pertinent topics. However, such
interactive features have been lacking in neural topic models. To correct this
lacuna, we introduce a user-friendly interaction for neural topic models. This
interaction permits users to assign a word label to a topic, leading to an
update in the topic model where the words in the topic become closely aligned
with the given label. Our approach encompasses two distinct kinds of neural
topic models. The first includes models where topic embeddings are trainable
and evolve during the training process. The second kind involves models where
topic embeddings are integrated post-training, offering a different approach to
topic refinement. To facilitate user interaction with these neural topic
models, we have developed an interactive interface. This interface enables
users to engage with and re-label topics as desired. We evaluate our method
through a human study, where users can relabel topics to find relevant
documents. Using our method, user labeling improves document rank scores,
helping to find more relevant documents to a given query when compared to no
user labeling.
Related papers
- Tethering Broken Themes: Aligning Neural Topic Models with Labels and Authors [2.048226951354646]
We introduce FANToM, a method for aligning neural topic models with both labels and authorship information.
Our approach demonstrates greater expressiveness than conventional topic models by learning the alignment between labels, topics, and authors.
arXiv Detail & Related papers (2024-10-22T11:20:47Z) - Personalized Topic Selection Model for Topic-Grounded Dialogue [24.74527189182273]
Current models tend to predict user-uninteresting and contextually irrelevant topics.
We propose a textbfPersonalized topic stextbfElection model for textbfTopic-grounded textbfDialogue, named textbfPETD.
Our proposed method can generate engaging and diverse responses, outperforming state-of-the-art baselines.
arXiv Detail & Related papers (2024-06-04T06:09:49Z) - TopicGPT: A Prompt-based Topic Modeling Framework [77.72072691307811]
We introduce TopicGPT, a prompt-based framework that uses large language models to uncover latent topics in a text collection.
It produces topics that align better with human categorizations compared to competing methods.
Its topics are also interpretable, dispensing with ambiguous bags of words in favor of topics with natural language labels and associated free-form descriptions.
arXiv Detail & Related papers (2023-11-02T17:57:10Z) - TopicAdapt- An Inter-Corpora Topics Adaptation Approach [27.450275637652418]
This paper proposes a neural topic model, TopicAdapt, that can adapt relevant topics from a related source corpus and also discover new topics in a target corpus that are absent in the source corpus.
Experiments over multiple datasets from diverse domains show the superiority of the proposed model against the state-of-the-art topic models.
arXiv Detail & Related papers (2023-10-08T02:56:44Z) - Multi-turn Dialogue Comprehension from a Topic-aware Perspective [70.37126956655985]
This paper proposes to model multi-turn dialogues from a topic-aware perspective.
We use a dialogue segmentation algorithm to split a dialogue passage into topic-concentrated fragments in an unsupervised way.
We also present a novel model, Topic-Aware Dual-Attention Matching (TADAM) Network, which takes topic segments as processing elements.
arXiv Detail & Related papers (2023-09-18T11:03:55Z) - A User-Centered, Interactive, Human-in-the-Loop Topic Modelling System [32.065158970382036]
Human-in-the-loop topic modelling incorporates users' knowledge into the modelling process, enabling them to refine the model iteratively.
Recent research has demonstrated the value of user feedback, but there are still issues to consider.
We developed a novel, interactive human-in-the-loop topic modeling system with a user-friendly interface.
arXiv Detail & Related papers (2023-04-04T13:05:10Z) - Interactive Text Generation [75.23894005664533]
We introduce a new Interactive Text Generation task that allows training generation models interactively without the costs of involving real users.
We train our interactive models using Imitation Learning, and our experiments against competitive non-interactive generation models show that models trained interactively are superior to their non-interactive counterparts.
arXiv Detail & Related papers (2023-03-02T01:57:17Z) - Dialogue History Matters! Personalized Response Selectionin Multi-turn
Retrieval-based Chatbots [62.295373408415365]
We propose a personalized hybrid matching network (PHMN) for context-response matching.
Our contributions are two-fold: 1) our model extracts personalized wording behaviors from user-specific dialogue history as extra matching information.
We evaluate our model on two large datasets with user identification, i.e., personalized dialogue Corpus Ubuntu (P- Ubuntu) and personalized Weibo dataset (P-Weibo)
arXiv Detail & Related papers (2021-03-17T09:42:11Z) - Improving Neural Topic Models using Knowledge Distillation [84.66983329587073]
We use knowledge distillation to combine the best attributes of probabilistic topic models and pretrained transformers.
Our modular method can be straightforwardly applied with any neural topic model to improve topic quality.
arXiv Detail & Related papers (2020-10-05T22:49:16Z) - Topic-Aware Multi-turn Dialogue Modeling [91.52820664879432]
This paper presents a novel solution for multi-turn dialogue modeling, which segments and extracts topic-aware utterances in an unsupervised way.
Our topic-aware modeling is implemented by a newly proposed unsupervised topic-aware segmentation algorithm and Topic-Aware Dual-attention Matching (TADAM) Network.
arXiv Detail & Related papers (2020-09-26T08:43:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.