QAnswer: Towards Question Answering Search over Websites
- URL: http://arxiv.org/abs/2401.09175v1
- Date: Wed, 17 Jan 2024 12:31:45 GMT
- Title: QAnswer: Towards Question Answering Search over Websites
- Abstract summary: Question Answering (QA) is increasingly used by search engines to provide results to their end-users.
We demonstrate web searches that combine QA over knowledge graphs and QA over free text.
- Score: 3.9123551183847964
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Question Answering (QA) is increasingly used by search engines to provide
results to their end-users, yet very few websites currently use QA technologies
for their search functionality. To illustrate the potential of QA technologies
for the website search practitioner, we demonstrate web searches that combine
QA over knowledge graphs and QA over free text -- each being usually tackled
separately. We also discuss the different benefits and drawbacks of both
approaches for web site searches. We use the case studies made of websites
hosted by the Wikimedia Foundation (namely Wikipedia and Wikidata). Differently
from a search engine (e.g. Google, Bing, etc), the data are indexed integrally,
i.e. we do not index only a subset, and they are indexed exclusively, i.e. we
index only data available on the corresponding website.
Related papers
- Search, Inspect, Fetch: Exploiting Structure-Aware Boolean Retrieval for Deep-Research Agents [50.35041517085015]
Existing deep-research agents use a Search--Visit workflow that retrieves whole webpages without considering the structure they expose through titles, headings, sections, and metadata.<n>We introduce textscSieve, a search--inspect-fetch strategy driven by a Boolean Query Language (BQL)<n>It searches webpage fields to filter candidates, uses an interchangeable ranker to order them, presents structure-rich result cards for inspection, and fetches only selected sections.
arXiv Detail & Related papers (2026-08-03T18:01:05Z) - Answering Without Referring: How AI Search Rewrites the Web's Economic Bargain [2.164440772155042]
We compare ChatGPT and Google information-seeking occasions using URL-level Comscore U.S. desktop clickstream.<n>ChatGPT produces outbound clicks in only 5.2% of conversation sessions, far below Google's referral ratio.<n> Wider access cuts search use by 9.4%, with search-referral losses largest for informational categories.
arXiv Detail & Related papers (2026-07-08T17:09:20Z) - How Generative AI Disrupts Search: An Empirical Study of Google Search, Gemini, and AI Overviews [5.313243639890497]
We compare the search results returned by Google's search engine, the accompanying AI Overview (AIO), and Gemini Flash 2.5 for each query.<n>For 51.5% of representative, real-user queries, AIOs are generated, and are displayed above the organic search results.<n>Traditional Google search is significantly more likely to retrieve information from popular or institutional websites in government or education.<n>Generative search engines are significantly more likely to retrieve Google-owned content.
arXiv Detail & Related papers (2026-04-30T12:32:21Z) - Rethinking Deep Research from the Perspective of Web Content Distribution Matching [86.90255285277256]
We propose WeDas, a Web Content Distribution Aware framework that incorporates search-space structural characteristics into the agent's observation space.<n>We introduce a few-shot probing mechanism that iteratively estimates the Query-Result Alignment Score.<n>As a plug-and-play module, WeDas consistently improves sub-goal completion and accuracy across four benchmarks.
arXiv Detail & Related papers (2026-03-07T14:51:17Z) - MindSearch: Mimicking Human Minds Elicits Deep AI Searcher [50.68599514830046]
We introduce MindSearch to mimic the human minds in web information seeking and integration.<n>The framework can be instantiated by a simple yet effective LLM-based multi-agent framework.<n> MindSearch demonstrates significant improvement in the response quality in terms of depth and breadth.
arXiv Detail & Related papers (2024-07-29T17:12:40Z) - Feature Engineering in Learning-to-Rank for Community Question Answering
Task [2.5091819952713057]
Community question answering (CQA) forums are Internet-based platforms where users ask questions about a topic and other expert users try to provide solutions.
Many CQA forums such as Quora, Stackoverflow, Yahoo!Answer, StackExchange exist with a lot of user-generated data.
These data are leveraged in automated CQA ranking systems where similar questions (and answers) are presented in response to the query of the user.
arXiv Detail & Related papers (2023-09-14T11:18:26Z) - WebCPM: Interactive Web Search for Chinese Long-form Question Answering [104.676752359777]
Long-form question answering (LFQA) aims at answering complex, open-ended questions with detailed, paragraph-length responses.
We introduce WebCPM, the first Chinese LFQA dataset.
We collect 5,500 high-quality question-answer pairs, together with 14,315 supporting facts and 121,330 web search actions.
arXiv Detail & Related papers (2023-05-11T14:47:29Z) - Graph Enhanced BERT for Query Understanding [55.90334539898102]
query understanding plays a key role in exploring users' search intents and facilitating users to locate their most desired information.
In recent years, pre-trained language models (PLMs) have advanced various natural language processing tasks.
We propose a novel graph-enhanced pre-training framework, GE-BERT, which can leverage both query content and the query graph.
arXiv Detail & Related papers (2022-04-03T16:50:30Z) - Improving Candidate Retrieval with Entity Profile Generation for
Wikidata Entity Linking [76.00737707718795]
We propose a novel candidate retrieval paradigm based on entity profiling.
We use the profile to query the indexed search engine to retrieve candidate entities.
Our approach complements the traditional approach of using a Wikipedia anchor-text dictionary.
arXiv Detail & Related papers (2022-02-27T17:38:53Z) - QALD-9-plus: A Multilingual Dataset for Question Answering over DBpedia
and Wikidata Translated by Native Speakers [68.9964449363406]
We extend one of the most popular KGQA benchmarks - QALD-9 by introducing high-quality questions' translations to 8 languages.
Five of the languages - Armenian, Ukrainian, Lithuanian, Bashkir and Belarusian - to our best knowledge were never considered in KGQA research community before.
arXiv Detail & Related papers (2022-01-31T22:19:55Z) - A Benchmark for Generalizable and Interpretable Temporal Question
Answering over Knowledge Bases [67.33560134350427]
TempQA-WD is a benchmark dataset for temporal reasoning.
It is based on Wikidata, which is the most frequently curated, openly available knowledge base.
arXiv Detail & Related papers (2022-01-15T08:49:09Z) - Open Domain Question Answering over Virtual Documents: A Unified
Approach for Data and Text [62.489652395307914]
We use the data-to-text method as a means for encoding structured knowledge for knowledge-intensive applications, i.e. open-domain question answering (QA)
Specifically, we propose a verbalizer-retriever-reader framework for open-domain QA over data and text where verbalized tables from Wikipedia and triples from Wikidata are used as augmented knowledge sources.
We show that our Unified Data and Text QA, UDT-QA, can effectively benefit from the expanded knowledge index, leading to large gains over text-only baselines.
arXiv Detail & Related papers (2021-10-16T00:11:21Z) - Applying Transfer Learning for Improving Domain-Specific Search
Experience Using Query to Question Similarity [0.0]
We discuss a framework for calculating similarities between a given input query and a set of predefined questions to retrieve the question which matches to it the most.
We have used it for the financial domain, but the framework is generalized for any domain-specific search engine and can be used in other domains as well.
arXiv Detail & Related papers (2021-01-07T03:27:32Z) - Search Engine Similarity Analysis: A Combined Content and Rankings
Approach [6.69087470775851]
We present an analysis of the affinity of the two major search engines, Google and Bing, along with DuckDuckGo.
We developed a new similarity metric that leverages both the content and the ranking of search responses.
We found that Google stands apart, but Bing and DuckDuckGo are largely indistinguishable from each other.
arXiv Detail & Related papers (2020-11-01T23:57:24Z) - A Deeper Investigation of the Importance of Wikipedia Links to the
Success of Search Engines [7.433327915285967]
We report the results of an investigation into the incidence of Wikipedia links in search engine results pages (SERPs)
We find that Wikipedia links are extremely common in important search contexts, appearing in 67-84% of all SERPs for common and trending queries, but less often for medical queries.
Our findings reinforce the complementary notions that (1) Wikipedia content and research has major impact outside of the Wikipedia domain and (2) powerful technologies like search engines are highly reliant on free content created by volunteers.
arXiv Detail & Related papers (2020-04-21T19:58:28Z) - Open Domain Question Answering Using Web Tables [8.25461115955717]
We develop an open-domain QA approach using web tables that works for both factoid and non-factoid queries.
Our solution is used in production in a major commercial web search engine and serves direct answers for tens of millions of real user queries per month.
arXiv Detail & Related papers (2020-01-10T01:25:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.