OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking

• URL: http://arxiv.org/abs/2501.09751v2
• Date: Thu, 20 Feb 2025 15:05:18 GMT
• Title: OmniThink: Expanding Knowledge Boundaries in Machine Writing through Thinking
• Authors: Zekun Xi, Wenbiao Yin, Jizhan Fang, Jialong Wu, Runnan Fang, Ningyu Zhang, Jiang Yong, Pengjun Xie, Fei Huang, Huajun Chen,
• Abstract summary: We propose OmniThink, a slow-thinking machine writing framework that emulates the human-like process of iterative expansion and reflection. Experimental results demonstrate that OmniThink improves the knowledge density of generated articles without compromising metrics such as coherence and depth. Human evaluations and expert feedback highlight the potential of OmniThink to address real-world challenges in the generation of long-form articles.
• Score: 57.06347681695629
• License:
• Abstract: Machine writing with large language models often relies on retrieval-augmented generation. However, these approaches remain confined within the boundaries of the model's predefined scope, limiting the generation of content with rich information. Specifically, vanilla-retrieved information tends to lack depth, novelty, and suffers from redundancy, which negatively impacts the quality of generated articles, leading to shallow, unoriginal, and repetitive outputs. To address these issues, we propose OmniThink, a slow-thinking machine writing framework that emulates the human-like process of iterative expansion and reflection. The core idea behind OmniThink is to simulate the cognitive behavior of learners as they slowly deepen their knowledge of the topics. Experimental results demonstrate that OmniThink improves the knowledge density of generated articles without compromising metrics such as coherence and depth. Human evaluations and expert feedback further highlight the potential of OmniThink to address real-world challenges in the generation of long-form articles.

Related papers

• Multi-Novelty: Improve the Diversity and Novelty of Contents Generated by Large Language Models via inference-time Multi-Views Brainstorming [3.591342811819669]
  Large Language Models (LLMs) demonstrate remarkable proficiency in generating accurate and fluent text. They often struggle with diversity and novelty, leading to repetitive or overly deterministic responses. We introduce inference-time multi-view brainstorming method, a novel approach that enriches input prompts with diverse perspectives.
  arXiv  Detail & Related papers  (2025-02-18T10:04:20Z)
• Think More, Hallucinate Less: Mitigating Hallucinations via Dual Process of Fast and Slow Thinking [124.69672273754144]
  HaluSearch is a novel framework that incorporates tree search-based algorithms. It frames text generation as a step-by-step reasoning process. We introduce a hierarchical thinking system switch mechanism inspired by the dual process theory in cognitive science.
  arXiv  Detail & Related papers  (2025-01-02T15:36:50Z)
• The Superalignment of Superhuman Intelligence with Large Language Models [63.96120398355404]
  We discuss the concept of superalignment from the learning perspective to answer this question. We highlight some key research problems in superalignment, namely, weak-to-strong generalization, scalable oversight, and evaluation. We present a conceptual framework for superalignment, which consists of three modules: an attacker which generates adversary queries trying to expose the weaknesses of a learner model; a learner which will refine itself by learning from scalable feedbacks generated by a critic model along with minimal human experts; and a critic which generates critics or explanations for a given query-response pair, with a target of improving the learner by criticizing.
  arXiv  Detail & Related papers  (2024-12-15T10:34:06Z)
• Good Idea or Not, Representation of LLM Could Tell [86.36317971482755]
  We focus on idea assessment, which aims to leverage the knowledge of large language models to assess the merit of scientific ideas. We release a benchmark dataset from nearly four thousand manuscript papers with full texts, meticulously designed to train and evaluate the performance of different approaches to this task. Our findings suggest that the representations of large language models hold more potential in quantifying the value of ideas than their generative outputs.
  arXiv  Detail & Related papers  (2024-09-07T02:07:22Z)
• Analysis of Plan-based Retrieval for Grounded Text Generation [78.89478272104739]
  hallucinations occur when a language model is given a generation task outside its parametric knowledge. A common strategy to address this limitation is to infuse the language models with retrieval mechanisms. We analyze how planning can be used to guide retrieval to further reduce the frequency of hallucinations.
  arXiv  Detail & Related papers  (2024-08-20T02:19:35Z)
• Bridging the Intent Gap: Knowledge-Enhanced Visual Generation [27.568260631117365]
  For visual content generation, discrepancies between user intentions and the generated content have been a longstanding problem. We propose a knowledge-enhanced iterative refinement framework for visual content generation. We demonstrate the efficacy of the proposed framework through preliminary results.
  arXiv  Detail & Related papers  (2024-05-21T07:07:44Z)
• Collapse of Self-trained Language Models [0.0]
  We explore the potential of self-training models on their own outputs, akin to how humans learn and build on their previous thoughts and actions. We find that extended self-training of the GPT-2 model leads to a significant degradation in performance, resulting in repetitive and collapsed token output.
  arXiv  Detail & Related papers  (2024-04-02T21:03:37Z)
• Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators [78.63553017938911]
  Large language models (LLMs) outperform information retrieval techniques for downstream knowledge-intensive tasks. However, community concerns abound regarding the factuality and potential implications of using this uncensored knowledge. We introduce CONNER, designed to evaluate generated knowledge from six important perspectives.
  arXiv  Detail & Related papers  (2023-10-11T08:22:37Z)
• The Creative Frontier of Generative AI: Managing the Novelty-Usefulness Tradeoff [0.4873362301533825]
  We explore the optimal balance between novelty and usefulness in generative Artificial Intelligence (AI) systems. Overemphasizing either aspect can lead to limitations such as hallucinations and memorization.
  arXiv  Detail & Related papers  (2023-06-06T11:44:57Z)
• Factual and Informative Review Generation for Explainable Recommendation [41.403493319602816]
  Previous models' generated content often contain factual hallucinations. Inspired by recent success in using retrieved content in addition to parametric knowledge for generation, we propose to augment the generator with a personalized retriever. Experiments on Yelp, TripAdvisor, and Amazon Movie Reviews dataset show our model could generate explanations that more reliably entail existing reviews, are more diverse, and are rated more informative by human evaluators.
  arXiv  Detail & Related papers  (2022-09-12T16:46:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.