Conversational Exploratory Search of Scholarly Publications Using Knowledge Graphs

• URL: http://arxiv.org/abs/2410.00427v1
• Date: Tue, 1 Oct 2024 06:16:07 GMT
• Title: Conversational Exploratory Search of Scholarly Publications Using Knowledge Graphs
• Authors: Phillip Schneider, Florian Matthes,
• Abstract summary: We develop a conversational search system for exploring scholarly publications using a knowledge graph. To assess the system's effectiveness, we employed various performance metrics and conducted a human evaluation with 40 participants.
• Score: 3.3916160303055567
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Traditional search methods primarily depend on string matches, while semantic search targets concept-based matches by recognizing underlying intents and contextual meanings of search terms. Semantic search is particularly beneficial for discovering scholarly publications where differences in vocabulary between users' search terms and document content are common, often yielding irrelevant search results. Many scholarly search engines have adopted knowledge graphs to represent semantic relations between authors, publications, and research concepts. However, users may face challenges when navigating these graphical search interfaces due to the complexity and volume of data, which impedes their ability to discover publications effectively. To address this problem, we developed a conversational search system for exploring scholarly publications using a knowledge graph. We outline the methodical approach for designing and implementing the proposed system, detailing its architecture and functional components. To assess the system's effectiveness, we employed various performance metrics and conducted a human evaluation with 40 participants, demonstrating how the conversational interface compares against a graphical interface with traditional text search. The findings from our evaluation provide practical insights for advancing the design of conversational search systems.

Related papers

• Taxonomy-guided Semantic Indexing for Academic Paper Search [51.07749719327668]
  TaxoIndex is a semantic index framework for academic paper search. It organizes key concepts from papers as a semantic index guided by an academic taxonomy. It can be flexibly employed to enhance existing dense retrievers.
  arXiv  Detail & Related papers  (2024-10-25T00:00:17Z)
• Query-oriented Data Augmentation for Session Search [71.84678750612754]
  We propose query-oriented data augmentation to enrich search logs and empower the modeling. We generate supplemental training pairs by altering the most important part of a search context. We develop several strategies to alter the current query, resulting in new training data with varying degrees of difficulty.
  arXiv  Detail & Related papers  (2024-07-04T08:08:33Z)
• Engineering Conversational Search Systems: A Review of Applications, Architectures, and Functional Components [4.262342157729123]
  This study investigates the links between theoretical studies and technical implementations of conversational search systems. We present a layered architecture framework and explain the core functions of conversational search systems. We reflect on our findings in light of the rapid progress in large language models, discussing their capabilities, limitations, and directions for future research.
  arXiv  Detail & Related papers  (2024-07-01T06:24:11Z)
• From Data to Dialogue: Leveraging the Structure of Knowledge Graphs for Conversational Exploratory Search [4.861125297881693]
  We propose a knowledge-driven dialogue system for exploring news articles by asking natural language questions. Based on a user study with 54 participants, we empirically evaluate the effectiveness of the graph-based exploratory search.
  arXiv  Detail & Related papers  (2023-10-08T12:52:09Z)
• DiscoverPath: A Knowledge Refinement and Retrieval System for Interdisciplinarity on Biomedical Research [96.10765714077208]
  Traditional keyword-based search engines fall short in assisting users who may not be familiar with specific terminologies. We present a knowledge graph-based paper search engine for biomedical research to enhance the user experience. The system, dubbed DiscoverPath, employs Named Entity Recognition (NER) and part-of-speech (POS) tagging to extract terminologies and relationships from article abstracts to create a KG.
  arXiv  Detail & Related papers  (2023-09-04T20:52:33Z)
• Investigating Conversational Search Behavior For Domain Exploration [0.5512295869673147]
  This study investigates open-ended search behavior for navigation through unknown information landscapes. We apply statistical analyses and process mining techniques to uncover general information-seeking patterns across five different domains.
  arXiv  Detail & Related papers  (2023-01-10T17:43:03Z)
• Semantic Search for Large Scale Clinical Ontologies [63.71950996116403]
  We present a deep learning approach to build a search system for large clinical vocabularies. We propose a Triplet-BERT model and a method that generates training data based on semantic training data. The model is evaluated using five real benchmark data sets and the results show that our approach achieves high results on both free text to concept and concept to searching concept vocabularies.
  arXiv  Detail & Related papers  (2022-01-01T05:15:42Z)
• Exposing Query Identification for Search Transparency [69.06545074617685]
  We explore the feasibility of approximate exposing query identification (EQI) as a retrieval task by reversing the role of queries and documents in two classes of search systems. We derive an evaluation metric to measure the quality of a ranking of exposing queries, as well as conducting an empirical analysis focusing on various practical aspects of approximate EQI.
  arXiv  Detail & Related papers  (2021-10-14T20:19:27Z)
• Enhancing Reading Strategies by Exploring A Theme-based Approach to Literature Surveys [5.004814662623872]
  We have designed a methodology that allows users to visually and thematically explore corpora, while developing personalised holistic reading strategies. Using in-depth semi-structured interviews and stimulated recall, we found that users: (i) selected papers that they otherwise would not have read, (ii) developed a more coherent reading strategy, and (iii) understood the thematic structure and relationships between papers more effectively.
  arXiv  Detail & Related papers  (2021-02-10T10:36:45Z)
• A New Neural Search and Insights Platform for Navigating and Organizing AI Research [56.65232007953311]
  We introduce a new platform, AI Research Navigator, that combines classical keyword search with neural retrieval to discover and organize relevant literature. We give an overview of the overall architecture of the system and of the components for document analysis, question answering, search, analytics, expert search, and recommendations.
  arXiv  Detail & Related papers  (2020-10-30T19:12:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.