Bot or Human? Detecting ChatGPT Imposters with A Single Question

• URL: http://arxiv.org/abs/2305.06424v4
• Date: Sun, 11 Aug 2024 18:56:50 GMT
• Title: Bot or Human? Detecting ChatGPT Imposters with A Single Question
• Authors: Hong Wang, Xuan Luo, Weizhi Wang, Xifeng Yan,
• Abstract summary: Large language models (LLMs) have recently demonstrated impressive capabilities in natural language understanding and generation. There is a concern that they can be misused for malicious purposes, such as fraud or denial-of-service attacks. We propose a framework named FLAIR, Finding Large Language Model Authenticity via a Single Inquiry and Response, to detect conversational bots in an online manner.
• Score: 29.231261118782925
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large language models (LLMs) like GPT-4 have recently demonstrated impressive capabilities in natural language understanding and generation. However, there is a concern that they can be misused for malicious purposes, such as fraud or denial-of-service attacks. Therefore, it is crucial to develop methods for detecting whether the party involved in a conversation is a bot or a human. In this paper, we propose a framework named FLAIR, Finding Large Language Model Authenticity via a Single Inquiry and Response, to detect conversational bots in an online manner. Specifically, we target a single question scenario that can effectively differentiate human users from bots. The questions are divided into two categories: those that are easy for humans but difficult for bots (e.g., counting, substitution, searching, and ASCII art reasoning), and those that are easy for bots but difficult for humans (e.g., memorization and computation). Our approach shows different strengths of these questions in their effectiveness, providing a new way for online service providers to protect themselves against nefarious activities. Our code and question set are available at https://github.com/hongwang600/FLAIR.

Related papers

• Exploring and Mitigating Adversarial Manipulation of Voting-Based Leaderboards [93.16294577018482]
  Arena, the most popular benchmark of this type, ranks models by asking users to select the better response between two randomly selected models. We show that an attacker can alter the leaderboard (to promote their favorite model or demote competitors) at the cost of roughly a thousand votes. Our attack consists of two steps: first, we show how an attacker can determine which model was used to generate a given reply with more than $95%$ accuracy; and then, the attacker can use this information to consistently vote against a target model.
  arXiv  Detail & Related papers  (2025-01-13T17:12:38Z)
• What is a Social Media Bot? A Global Comparison of Bot and Human Characteristics [5.494111035517598]
  Bots tend to use linguistic cues that can be easily automated while humans use cues that require dialogue understanding. These conclusions are based on a large-scale analysis of social media tweets across 200mil users across 7 events.
  arXiv  Detail & Related papers  (2025-01-01T14:45:43Z)
• Adversarial Botometer: Adversarial Analysis for Social Bot Detection [1.9280536006736573]
  Social bots produce content that mimics human creativity. Malicious social bots emerge to deceive people with their unrealistic content. We evaluate the behavior of a text-based bot detector in a competitive environment.
  arXiv  Detail & Related papers  (2024-05-03T11:28:21Z)
• Spot the bot: Coarse-Grained Partition of Semantic Paths for Bots and Humans [55.2480439325792]
  This paper focuses on comparing structures of the coarse-grained partitions of semantic paths for human-written and bot-generated texts. As the semantic structure may be different for different languages, we investigate Russian, English, German, and Vietnamese languages.
  arXiv  Detail & Related papers  (2024-02-27T10:38:37Z)
• My Brother Helps Me: Node Injection Based Adversarial Attack on Social Bot Detection [69.99192868521564]
  Social platforms such as Twitter are under siege from a multitude of fraudulent users. Due to the structure of social networks, the majority of methods are based on the graph neural network(GNN), which is susceptible to attacks. We propose a node injection-based adversarial attack method designed to deceive bot detection models.
  arXiv  Detail & Related papers  (2023-10-11T03:09:48Z)
• You are a Bot! -- Studying the Development of Bot Accusations on Twitter [1.7626250599622473]
  In the absence of ground truth data, researchers may want to tap into the wisdom of the crowd. Our research presents the first large-scale study of bot accusations on Twitter. It shows how the term bot became an instrument of dehumanization in social media conversations.
  arXiv  Detail & Related papers  (2023-02-01T16:09:11Z)
• Implementing a Chatbot Solution for Learning Management System [0.0]
  One of the main problem that chatbots face today is to mimic human language. Extreme programming methodology was chosen to use integrate ChatterBot, Pyside2, web scraping and Tampermonkey into Blackboard. We showed the plausibility of integrating an AI bot in an educational setting.
  arXiv  Detail & Related papers  (2022-06-27T11:04:42Z)
• CheerBots: Chatbots toward Empathy and Emotionusing Reinforcement Learning [60.348822346249854]
  This study presents a framework whereby several empathetic chatbots are based on understanding users' implied feelings and replying empathetically for multiple dialogue turns. We call these chatbots CheerBots. CheerBots can be retrieval-based or generative-based and were finetuned by deep reinforcement learning. To respond in an empathetic way, we develop a simulating agent, a Conceptual Human Model, as aids for CheerBots in training with considerations on changes in user's emotional states in the future to arouse sympathy.
  arXiv  Detail & Related papers  (2021-10-08T07:44:47Z)
• Detecting Bot-Generated Text by Characterizing Linguistic Accommodation in Human-Bot Interactions [9.578008322407928]
  Language generation models' democratization makes it easier to generate human-like text at-scale for nefarious activities. It is essential to understand how people interact with bots and develop methods to detect bot-generated text. This paper shows that bot-generated text detection methods are more robust across datasets and models if we use information about how people respond to it.
  arXiv  Detail & Related papers  (2021-06-02T14:10:28Z)
• Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention [55.77218465471519]
  This paper proposes an innovative framework to train chatbots to possess human-like intentions. Our framework included a guiding robot and an interlocutor model that plays the role of humans. We examined our framework using three experimental setups and evaluate the guiding robot with four different metrics to demonstrated flexibility and performance advantages.
  arXiv  Detail & Related papers  (2021-03-30T15:24:37Z)
• Detection of Novel Social Bots by Ensembles of Specialized Classifiers [60.63582690037839]
  Malicious actors create inauthentic social media accounts controlled in part by algorithms, known as social bots, to disseminate misinformation and agitate online discussion. We show that different types of bots are characterized by different behavioral features. We propose a new supervised learning method that trains classifiers specialized for each class of bots and combines their decisions through the maximum rule.
  arXiv  Detail & Related papers  (2020-06-11T22:59:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.