Supporting search engines with knowledge and context
- URL: http://arxiv.org/abs/2102.06762v1
- Date: Fri, 12 Feb 2021 20:28:25 GMT
- Title: Supporting search engines with knowledge and context
- Authors: Nikos Voskarides
- Abstract summary: In the first part of this thesis, we study how to make structured knowledge more accessible to the user.
In the second part of this thesis, we study how to improve interactive knowledge gathering.
In the final part of this thesis, we focus on search engine support for professional writers in the news domain.
- Score: 1.0152838128195467
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Search engines leverage knowledge to improve information access. In order to
effectively leverage knowledge, search engines should account for context,
i.e., information about the user and query. In this thesis, we aim to support
search engines in leveraging knowledge while accounting for context. In the
first part of this thesis, we study how to make structured knowledge more
accessible to the user when the search engine proactively provides such
knowledge as context to enrich search results. As a first task, we study how to
retrieve descriptions of knowledge facts from a text corpus. Next, we study how
to automatically generate knowledge fact descriptions. And finally, we study
how to contextualize knowledge facts, that is, to automatically find facts
related to a query fact. In the second part of this thesis, we study how to
improve interactive knowledge gathering. We focus on conversational search,
where the user interacts with the search engine to gather knowledge over large
unstructured knowledge repositories. We focus on multi-turn passage retrieval
as an instance of conversational search. We propose to model query resolution
as a term classification task and propose a method to address it. In the final
part of this thesis, we focus on search engine support for professional writers
in the news domain. We study how to support such writers create
event-narratives by exploring knowledge from a corpus of news articles. We
propose a dataset construction procedure for this task that relies on existing
news articles to simulate incomplete narratives and relevant articles. We study
the performance of multiple rankers, lexical and semantic, and provide insights
into the characteristics of this task.
Related papers
- Crafting Knowledge: Exploring the Creative Mechanisms of Chat-Based
Search Engines [3.5845457075304368]
This research aims to dissect the mechanisms through which an LLM-powered search engine, specifically Bing Chat, selects information sources for its responses.
Bing Chat exhibits a preference for content that is not only readable and formally structured, but also demonstrates lower perplexity levels.
Our investigation documents a greater similarity among websites cited by RAG technologies compared to those ranked highest by conventional search engines.
arXiv Detail & Related papers (2024-02-29T18:20:37Z) - DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain
Question Answering over Knowledge Base and Text [73.68051228972024]
Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when relying on their internal knowledge.
Retrieval-augmented LLMs have emerged as a potential solution to ground LLMs in external knowledge.
arXiv Detail & Related papers (2023-10-31T04:37:57Z) - Beyond Factuality: A Comprehensive Evaluation of Large Language Models
as Knowledge Generators [78.63553017938911]
Large language models (LLMs) outperform information retrieval techniques for downstream knowledge-intensive tasks.
However, community concerns abound regarding the factuality and potential implications of using this uncensored knowledge.
We introduce CONNER, designed to evaluate generated knowledge from six important perspectives.
arXiv Detail & Related papers (2023-10-11T08:22:37Z) - From Data to Dialogue: Leveraging the Structure of Knowledge Graphs for
Conversational Exploratory Search [4.861125297881693]
We propose a knowledge-driven dialogue system for exploring news articles by asking natural language questions.
Based on a user study with 54 participants, we empirically evaluate the effectiveness of the graph-based exploratory search.
arXiv Detail & Related papers (2023-10-08T12:52:09Z) - DiscoverPath: A Knowledge Refinement and Retrieval System for
Interdisciplinarity on Biomedical Research [96.10765714077208]
Traditional keyword-based search engines fall short in assisting users who may not be familiar with specific terminologies.
We present a knowledge graph-based paper search engine for biomedical research to enhance the user experience.
The system, dubbed DiscoverPath, employs Named Entity Recognition (NER) and part-of-speech (POS) tagging to extract terminologies and relationships from article abstracts to create a KG.
arXiv Detail & Related papers (2023-09-04T20:52:33Z) - KETM:A Knowledge-Enhanced Text Matching method [0.0]
We introduce a new model for text matching called the Knowledge Enhanced Text Matching model (KETM)
We use Wiktionary to retrieve the text word definitions as our external knowledge.
We fuse text and knowledge using a gating mechanism to learn the ratio of text and knowledge fusion.
arXiv Detail & Related papers (2023-08-11T17:08:14Z) - Search-Engine-augmented Dialogue Response Generation with Cheaply
Supervised Query Production [98.98161995555485]
We propose a dialogue model that can access the vast and dynamic information from any search engine for response generation.
As the core module, a query producer is used to generate queries from a dialogue context to interact with a search engine.
Experiments show that our query producer can achieve R@1 and R@5 rates of 62.4% and 74.8% for retrieving gold knowledge.
arXiv Detail & Related papers (2023-02-16T01:58:10Z) - MORTY: Structured Summarization for Targeted Information Extraction from
Scholarly Articles [0.0]
We present MORTY, an information extraction technique that creates structured summaries of text from scholarly articles.
Our approach condenses the article's full-text to property-value pairs as a segmented text snippet called structured summary.
We also present a sizable scholarly dataset combining structured summaries retrieved from a scholarly knowledge graph and corresponding publicly available scientific articles.
arXiv Detail & Related papers (2022-12-11T06:49:29Z) - A New Neural Search and Insights Platform for Navigating and Organizing
AI Research [56.65232007953311]
We introduce a new platform, AI Research Navigator, that combines classical keyword search with neural retrieval to discover and organize relevant literature.
We give an overview of the overall architecture of the system and of the components for document analysis, question answering, search, analytics, expert search, and recommendations.
arXiv Detail & Related papers (2020-10-30T19:12:25Z) - Machine Knowledge: Creation and Curation of Comprehensive Knowledge
Bases [28.856786775318486]
Large-scale knowledge bases, also known as knowledge graphs, have been automatically constructed from web contents and text sources.
This article surveys fundamental concepts and practical methods for creating and large knowledge bases.
arXiv Detail & Related papers (2020-09-24T09:28:13Z) - Improving Machine Reading Comprehension with Contextualized Commonsense
Knowledge [62.46091695615262]
We aim to extract commonsense knowledge to improve machine reading comprehension.
We propose to represent relations implicitly by situating structured knowledge in a context.
We employ a teacher-student paradigm to inject multiple types of contextualized knowledge into a student machine reader.
arXiv Detail & Related papers (2020-09-12T17:20:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.