ChatGPT is Good but Bing Chat is Better for Vietnamese Students
- URL: http://arxiv.org/abs/2307.08272v3
- Date: Sun, 30 Jul 2023 01:04:05 GMT
- Title: ChatGPT is Good but Bing Chat is Better for Vietnamese Students
- Authors: Xuan-Quy Dao, Ngoc-Bich Le
- Abstract summary: This study examines the efficacy of two SOTA large language models (LLMs), namely ChatGPT and Microsoft Bing Chat (BingChat), in catering to the needs of Vietnamese students.
We conduct a comparative analysis of their academic achievements in various disciplines, encompassing mathematics, literature, English language, physics, chemistry, biology, history, geography, and civic education.
The results of our study suggest that BingChat demonstrates superior performance compared to ChatGPT across a wide range of subjects, with the exception of literature, where ChatGPT exhibits better performance.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: This study examines the efficacy of two SOTA large language models (LLMs),
namely ChatGPT and Microsoft Bing Chat (BingChat), in catering to the needs of
Vietnamese students. Although ChatGPT exhibits proficiency in multiple
disciplines, Bing Chat emerges as the more advantageous option. We conduct a
comparative analysis of their academic achievements in various disciplines,
encompassing mathematics, literature, English language, physics, chemistry,
biology, history, geography, and civic education. The results of our study
suggest that BingChat demonstrates superior performance compared to ChatGPT
across a wide range of subjects, with the exception of literature, where
ChatGPT exhibits better performance. Additionally, BingChat utilizes the more
advanced GPT-4 technology in contrast to ChatGPT, which is built upon GPT-3.5.
This allows BingChat to improve to comprehension, reasoning and generation of
creative and informative text. Moreover, the fact that BingChat is accessible
in Vietnam and its integration of hyperlinks and citations within responses
serve to reinforce its superiority. In our analysis, it is evident that while
ChatGPT exhibits praiseworthy qualities, BingChat presents a more apdated
solutions for Vietnamese students.
Related papers
- The use of ChatGPT in higher education: The advantages and disadvantages [0.0]
ChatGPT is an artificial intelligence technology developed by OpenAI.
This study examines the application of ChatGPT in higher education to comprehend and produce high-level instruction.
arXiv Detail & Related papers (2024-03-28T09:00:05Z) - Complementary Advantages of ChatGPTs and Human Readers in Reasoning:
Evidence from English Text Reading Comprehension [12.240611073541597]
ChatGPT has shown its great power in text processing, including its reasoning ability from text reading.
There has not been any direct comparison between human readers and ChatGPT in reasoning ability related to text reading.
This study was undertaken to investigate how ChatGPTs and Chinese senior school students exhibited their reasoning ability from English narrative texts.
arXiv Detail & Related papers (2023-11-17T06:13:02Z) - Primacy Effect of ChatGPT [69.49920102917598]
We study the primacy effect of ChatGPT: the tendency of selecting the labels at earlier positions as the answer.
We hope that our experiments and analyses provide additional insights into building more reliable ChatGPT-based solutions.
arXiv Detail & Related papers (2023-10-20T00:37:28Z) - "ChatGPT, a Friend or Foe for Education?" Analyzing the User's
Perspectives on the Latest AI Chatbot Via Reddit [0.0]
This study has analyzed 247 Reddit top posts related to the educational use of ChatGPT.
Results show that the majority of the users took a neutral viewpoint.
There was more positive perception than negative regarding the usefulness of ChatGPT in education.
arXiv Detail & Related papers (2023-09-27T23:59:44Z) - Performance Comparison of Large Language Models on VNHSGE English
Dataset: OpenAI ChatGPT, Microsoft Bing Chat, and Google Bard [0.0]
Three large language models (LLMs) were compared on the VNHSGE English dataset.
The results show that BingChat is better than ChatGPT and Bard.
BingChat, Bard and ChatGPT outperform Vietnamese students in English language proficiency.
arXiv Detail & Related papers (2023-07-05T13:40:57Z) - Phoenix: Democratizing ChatGPT across Languages [68.75163236421352]
We release a large language model "Phoenix", achieving competitive performance among open-source English and Chinese models.
We believe this work will be beneficial to make ChatGPT more accessible, especially in countries where people cannot use ChatGPT due to restrictions from OpenAI or local goverments.
arXiv Detail & Related papers (2023-04-20T16:50:04Z) - ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large
Language Models in Multilingual Learning [70.57126720079971]
Large language models (LLMs) have emerged as the most important breakthroughs in natural language processing (NLP)
This paper evaluates ChatGPT on 7 different tasks, covering 37 diverse languages with high, medium, low, and extremely low resources.
Compared to the performance of previous models, our extensive experimental results demonstrate a worse performance of ChatGPT for different NLP tasks and languages.
arXiv Detail & Related papers (2023-04-12T05:08:52Z) - ChatGPT is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models [49.52083248451775]
Large language models (LLMs) have made significant progress in NLP.
We specifically focus on ChatGPT, a widely used and easily accessible LLM.
We conduct a series of experiments on 11 datasets to evaluate ChatGPT's commonsense abilities.
arXiv Detail & Related papers (2023-03-29T03:05:43Z) - Seeing ChatGPT Through Students' Eyes: An Analysis of TikTok Data [3.441021278275805]
We analyzed the content of the 100 most popular videos in English tagged with #chatgpt, which collectively garnered over 250 million views.
Most of the videos promoted the use of ChatGPT for tasks like writing essays or code.
What is, however, missing from the analyzed clips on TikTok are videos that discuss ChatGPT producing content that is nonsensical or unfaithful to the training data.
arXiv Detail & Related papers (2023-03-09T15:46:54Z) - Can ChatGPT Understand Too? A Comparative Study on ChatGPT and
Fine-tuned BERT [103.57103957631067]
ChatGPT has attracted great attention, as it can generate fluent and high-quality responses to human inquiries.
We evaluate ChatGPT's understanding ability by evaluating it on the most popular GLUE benchmark, and comparing it with 4 representative fine-tuned BERT-style models.
We find that: 1) ChatGPT falls short in handling paraphrase and similarity tasks; 2) ChatGPT outperforms all BERT models on inference tasks by a large margin; 3) ChatGPT achieves comparable performance compared with BERT on sentiment analysis and question answering tasks.
arXiv Detail & Related papers (2023-02-19T12:29:33Z) - Is ChatGPT A Good Translator? Yes With GPT-4 As The Engine [97.8609714773255]
We evaluate ChatGPT for machine translation, including translation prompt, multilingual translation, and translation robustness.
ChatGPT performs competitively with commercial translation products but lags behind significantly on low-resource or distant languages.
With the launch of the GPT-4 engine, the translation performance of ChatGPT is significantly boosted.
arXiv Detail & Related papers (2023-01-20T08:51:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.