Improving Primary Healthcare Workflow Using Extreme Summarization of
Scientific Literature Based on Generative AI
- URL: http://arxiv.org/abs/2307.15715v1
- Date: Mon, 24 Jul 2023 21:42:27 GMT
- Title: Improving Primary Healthcare Workflow Using Extreme Summarization of
Scientific Literature Based on Generative AI
- Authors: Gregor Stiglic, Leon Kopitar, Lucija Gosak, Primoz Kocbek, Zhe He,
Prithwish Chakraborty, Pablo Meyer, Jiang Bian
- Abstract summary: Our objective is to investigate the potential of generative artificial intelligence in diminishing the cognitive load experienced by practitioners.
Our research demonstrates that the use of generative AI for literature review is efficient and effective.
- Score: 8.901148687545103
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Primary care professionals struggle to keep up to date with the latest
scientific literature critical in guiding evidence-based practice related to
their daily work. To help solve the above-mentioned problem, we employed
generative artificial intelligence techniques based on large-scale language
models to summarize abstracts of scientific papers. Our objective is to
investigate the potential of generative artificial intelligence in diminishing
the cognitive load experienced by practitioners, thus exploring its ability to
alleviate mental effort and burden. The study participants were provided with
two use cases related to preventive care and behavior change, simulating a
search for new scientific literature. The study included 113 university
students from Slovenia and the United States randomized into three distinct
study groups. The first group was assigned to the full abstracts. The second
group was assigned to the short abstracts generated by AI. The third group had
the option to select a full abstract in addition to the AI-generated short
summary. Each use case study included ten retrieved abstracts. Our research
demonstrates that the use of generative AI for literature review is efficient
and effective. The time needed to answer questions related to the content of
abstracts was significantly lower in groups two and three compared to the first
group using full abstracts. The results, however, also show significantly lower
accuracy in extracted knowledge in cases where full abstract was not available.
Such a disruptive technology could significantly reduce the time required for
healthcare professionals to keep up with the most recent scientific literature;
nevertheless, further developments are needed to help them comprehend the
knowledge accurately.
Related papers
- Transforming Science with Large Language Models: A Survey on AI-assisted Scientific Discovery, Experimentation, Content Generation, and Evaluation [58.064940977804596]
A plethora of new AI models and tools has been proposed, promising to empower researchers and academics worldwide to conduct their research more effectively and efficiently.
Ethical concerns regarding shortcomings of these tools and potential for misuse take a particularly prominent place in our discussion.
arXiv Detail & Related papers (2025-02-07T18:26:45Z) - GeneSUM: Large Language Model-based Gene Summary Extraction [20.181381276458488]
We propose GeneSUM, a two-stage automated gene summary extractor utilizing a large language model (LLM)
Our approach retrieves and eliminates redundancy of target gene literature and then fine-tunes the LLM to refine and streamline the summarization process.
arXiv Detail & Related papers (2024-12-24T04:20:43Z) - Can Artificial Intelligence Generate Quality Research Topics Reflecting Patient Concerns? [0.2801039649976666]
We propose an automated framework leveraging innovative natural language processing (NLP) and artificial intelligence (AI)
We analyzed 614,464 patient messages from 25,549 individuals with breast or skin cancer obtained from a large academic hospital.
We generated research topics to resolve the defined issues using a widely used AI.
arXiv Detail & Related papers (2024-11-15T20:24:38Z) - O1 Replication Journey: A Strategic Progress Report -- Part 1 [52.062216849476776]
This paper introduces a pioneering approach to artificial intelligence research, embodied in our O1 Replication Journey.
Our methodology addresses critical challenges in modern AI research, including the insularity of prolonged team-based projects.
We propose the journey learning paradigm, which encourages models to learn not just shortcuts, but the complete exploration process.
arXiv Detail & Related papers (2024-10-08T15:13:01Z) - ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Models [56.08917291606421]
ResearchAgent is an AI-based system for ideation and operationalization of novel work.
ResearchAgent automatically defines novel problems, proposes methods and designs experiments, while iteratively refining them.
We experimentally validate our ResearchAgent on scientific publications across multiple disciplines.
arXiv Detail & Related papers (2024-04-11T13:36:29Z) - A Literature Review of Literature Reviews in Pattern Analysis and Machine Intelligence [55.33653554387953]
Pattern Analysis and Machine Intelligence (PAMI) has led to numerous literature reviews aimed at collecting and fragmented information.
This paper presents a thorough analysis of these literature reviews within the PAMI field.
We try to address three core research questions: (1) What are the prevalent structural and statistical characteristics of PAMI literature reviews; (2) What strategies can researchers employ to efficiently navigate the growing corpus of reviews; and (3) What are the advantages and limitations of AI-generated reviews compared to human-authored ones.
arXiv Detail & Related papers (2024-02-20T11:28:50Z) - Generative AI in Writing Research Papers: A New Type of Algorithmic Bias
and Uncertainty in Scholarly Work [0.38850145898707145]
Large language models (LLMs) and generative AI tools present challenges in identifying and addressing biases.
generative AI tools are susceptible to goal misgeneralization, hallucinations, and adversarial attacks such as red teaming prompts.
We find that incorporating generative AI in the process of writing research manuscripts introduces a new type of context-induced algorithmic bias.
arXiv Detail & Related papers (2023-12-04T04:05:04Z) - Experimental Evidence on Negative Impact of Generative AI on Scientific
Learning Outcomes [0.0]
Using AI for summarization significantly improved both quality and output.
Individuals with a robust background in the reading topic and superior reading/writing skills benefitted the most.
arXiv Detail & Related papers (2023-09-23T21:59:40Z) - The Role of AI in Drug Discovery: Challenges, Opportunities, and
Strategies [97.5153823429076]
The benefits, challenges and drawbacks of AI in this field are reviewed.
The use of data augmentation, explainable AI, and the integration of AI with traditional experimental methods are also discussed.
arXiv Detail & Related papers (2022-12-08T23:23:39Z) - What's New? Summarizing Contributions in Scientific Literature [85.95906677964815]
We introduce a new task of disentangled paper summarization, which seeks to generate separate summaries for the paper contributions and the context of the work.
We extend the S2ORC corpus of academic articles by adding disentangled "contribution" and "context" reference labels.
We propose a comprehensive automatic evaluation protocol which reports the relevance, novelty, and disentanglement of generated outputs.
arXiv Detail & Related papers (2020-11-06T02:23:01Z) - Automatic Text Summarization of COVID-19 Medical Research Articles using
BERT and GPT-2 [8.223517872575712]
We take advantage of the recent advances in pre-trained NLP models, BERT and OpenAI GPT-2.
Our model provides abstractive and comprehensive information based on keywords extracted from the original articles.
Our work can help the the medical community, by providing succinct summaries of articles for which the abstract are not already available.
arXiv Detail & Related papers (2020-06-03T00:54:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.