ChatGPT in the Age of Generative AI and Large Language Models: A Concise
Survey
- URL: http://arxiv.org/abs/2307.04251v2
- Date: Sat, 15 Jul 2023 22:45:04 GMT
- Title: ChatGPT in the Age of Generative AI and Large Language Models: A Concise
Survey
- Authors: Salman Mohamadi, Ghulam Mujtaba, Ngan Le, Gianfranco Doretto, Donald
A. Adjeroh
- Abstract summary: ChatGPT is a large language model (LLM) created by OpenAI.
It has revolutionized the field of natural language processing (NLP)
- Score: 10.264932370912314
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: ChatGPT is a large language model (LLM) created by OpenAI that has been
carefully trained on a large amount of data. It has revolutionized the field of
natural language processing (NLP) and has pushed the boundaries of LLM
capabilities. ChatGPT has played a pivotal role in enabling widespread public
interaction with generative artificial intelligence (GAI) on a large scale. It
has also sparked research interest in developing similar technologies and
investigating their applications and implications. In this paper, our primary
goal is to provide a concise survey on the current lines of research on ChatGPT
and its evolution. We considered both the glass box and black box views of
ChatGPT, encompassing the components and foundational elements of the
technology, as well as its applications, impacts, and implications. The glass
box approach focuses on understanding the inner workings of the technology, and
the black box approach embraces it as a complex system, and thus examines its
inputs, outputs, and effects. This paves the way for a comprehensive
exploration of the technology and provides a road map for further research and
experimentation. We also lay out essential foundational literature on LLMs and
GAI in general and their connection with ChatGPT. This overview sheds light on
existing and missing research lines in the emerging field of LLMs, benefiting
both public users and developers. Furthermore, the paper delves into the broad
spectrum of applications and significant concerns in fields such as education,
research, healthcare, finance, etc.
Related papers
- A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models [71.25225058845324]
Large Language Models (LLMs) have demonstrated revolutionary abilities in language understanding and generation.
Retrieval-Augmented Generation (RAG) can offer reliable and up-to-date external knowledge.
RA-LLMs have emerged to harness external and authoritative knowledge bases, rather than relying on the model's internal knowledge.
arXiv Detail & Related papers (2024-05-10T02:48:45Z) - ChatGPT Alternative Solutions: Large Language Models Survey [0.0]
Large Language Models (LLMs) have ignited a surge in research contributions within this domain.
Recent years have witnessed a dynamic synergy between academia and industry, propelling the field of LLM research to new heights.
This survey furnishes a well-rounded perspective on the current state of generative AI, shedding light on opportunities for further exploration, enhancement, and innovation.
arXiv Detail & Related papers (2024-03-21T15:16:50Z) - Exploring ChatGPT and its Impact on Society [7.652195319352287]
ChatGPT is a large language model that can generate human-like responses in a conversational context.
It has the potential to revolutionize various industries and transform the way we interact with technology.
However, the use of ChatGPT has also raised several concerns, including ethical, social, and employment challenges.
arXiv Detail & Related papers (2024-02-21T16:44:35Z) - ChatGPT's One-year Anniversary: Are Open-Source Large Language Models
Catching up? [71.12709925152784]
ChatGPT has brought a seismic shift in the entire landscape of AI.
It showed that a model could answer human questions and follow instructions on a broad panel of tasks.
While closed-source LLMs generally outperform their open-source counterparts, the progress on the latter has been rapid.
This has crucial implications not only on research but also on business.
arXiv Detail & Related papers (2023-11-28T17:44:51Z) - "It's not like Jarvis, but it's pretty close!" -- Examining ChatGPT's
Usage among Undergraduate Students in Computer Science [3.6936132187945923]
Large language models (LLMs) such as ChatGPT and Google Bard have garnered significant attention in the academic community.
This study adopts a student-first approach to comprehensively understand how undergraduate computer science students utilize ChatGPT.
arXiv Detail & Related papers (2023-11-16T08:10:18Z) - A Survey on Detection of LLMs-Generated Content [97.87912800179531]
The ability to detect LLMs-generated content has become of paramount importance.
We aim to provide a detailed overview of existing detection strategies and benchmarks.
We also posit the necessity for a multi-faceted approach to defend against various attacks.
arXiv Detail & Related papers (2023-10-24T09:10:26Z) - Large Language Models for Information Retrieval: A Survey [57.7992728506871]
Information retrieval has evolved from term-based methods to its integration with advanced neural models.
Recent research has sought to leverage large language models (LLMs) to improve IR systems.
We delve into the confluence of LLMs and IR systems, including crucial aspects such as query rewriters, retrievers, rerankers, and readers.
arXiv Detail & Related papers (2023-08-14T12:47:22Z) - Decoding ChatGPT: A Taxonomy of Existing Research, Current Challenges,
and Possible Future Directions [2.5427838419316946]
Chat Generative Pre-trained Transformer (ChatGPT) has gained significant interest and attention since its launch in November 2022.
We present a comprehensive review of over 100 Scopus-indexed publications on ChatGPT.
arXiv Detail & Related papers (2023-07-26T11:10:04Z) - How Can Recommender Systems Benefit from Large Language Models: A Survey [82.06729592294322]
Large language models (LLM) have shown impressive general intelligence and human-like capabilities.
We conduct a comprehensive survey on this research direction from the perspective of the whole pipeline in real-world recommender systems.
arXiv Detail & Related papers (2023-06-09T11:31:50Z) - ChatGPT: Vision and Challenges [1.0591256138276635]
ChatGPT has become a prominent AI language model.
This article investigates into the background and development of the technology behind it, as well as its popular applications.
We speculate on the future of ChatGPT by considering various possibilities for study and development, such as energy-efficiency, cybersecurity, enhancing its applicability to additional technologies (Robotics and Computer Vision), strengthening human-AI communications, and bridging the technological gap.
arXiv Detail & Related papers (2023-05-08T14:54:44Z) - ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large
Language Models in Multilingual Learning [70.57126720079971]
Large language models (LLMs) have emerged as the most important breakthroughs in natural language processing (NLP)
This paper evaluates ChatGPT on 7 different tasks, covering 37 diverse languages with high, medium, low, and extremely low resources.
Compared to the performance of previous models, our extensive experimental results demonstrate a worse performance of ChatGPT for different NLP tasks and languages.
arXiv Detail & Related papers (2023-04-12T05:08:52Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.