The Impact of Performance Expectancy, Workload, Risk, and Satisfaction on Trust in ChatGPT: Cross-sectional Survey Analysis

• URL: http://arxiv.org/abs/2311.05632v1
• Date: Fri, 20 Oct 2023 16:06:11 GMT
• Title: The Impact of Performance Expectancy, Workload, Risk, and Satisfaction on Trust in ChatGPT: Cross-sectional Survey Analysis
• Authors: Hamid Shamszare and Avishek Choudhury
• Abstract summary: This study investigated how perceived workload, satisfaction, performance expectancy, and risk-benefit perception influenced users' trust in Chat Generative Pre-Trained Transformer (ChatGPT) A semi-structured, web-based survey was conducted among adults in the United States who actively use ChatGPT at least once a month.
• Score: 1.9580473532948401
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This study investigated how perceived workload, satisfaction, performance expectancy, and risk-benefit perception influenced users' trust in Chat Generative Pre-Trained Transformer (ChatGPT). We aimed to understand the nuances of user engagement and provide insights to improve future design and adoption strategies for similar technologies. A semi-structured, web-based survey was conducted among adults in the United States who actively use ChatGPT at least once a month. The survey was conducted from 22nd February 2023 through 24th March 2023. We used structural equation modeling to understand the relationships among the constructs of perceived workload, satisfaction, performance expectancy, risk-benefit, and trust. The analysis of 607 survey responses revealed a significant negative relationship between perceived workload and user satisfaction, a negative but insignificant relationship between perceived workload and trust, and a positive relationship between user satisfaction and trust. Trust was also found to increase with performance expectancy. In contrast, the relationship between the benefit-to-risk ratio of using ChatGPT and trust was insignificant. The findings underscore the importance of ensuring user-friendly design and functionality in AI-based applications to reduce workload and enhance user satisfaction, thereby increasing user trust. Future research should further explore the relationship between the benefit-to-risk ratio and trust in the context of AI chatbots.

Related papers

• User Intent to Use DeepSeek for Healthcare Purposes and their Trust in the Large Language Model: Multinational Survey Study [1.474723404975345]
  Large language models (LLMs) increasingly serve as interactive healthcare resources, yet user acceptance remains underexplored. This study examines how ease of use, perceived usefulness, trust, and risk perception interact to shape intentions to adopt DeepSeek.
  arXiv  Detail & Related papers  (2025-02-18T16:49:36Z)
• Hesitation and Tolerance in Recommender Systems [33.755867719862394]
  We find that hesitation is widespread and has a profound impact on user experiences. When users spend additional time engaging with content they are ultimately uninterested in, this can lead to negative emotions, a phenomenon we term as tolerance. We identify signals indicative of tolerance behavior and analyzed datasets from both e-commerce and short-video platforms.
  arXiv  Detail & Related papers  (2024-12-13T08:14:10Z)
• Quantifying User Coherence: A Unified Framework for Cross-Domain Recommendation Analysis [69.37718774071793]
  This paper introduces novel information-theoretic measures for understanding recommender systems. We evaluate 7 recommendation algorithms across 9 datasets, revealing the relationships between our measures and standard performance metrics.
  arXiv  Detail & Related papers  (2024-10-03T13:02:07Z)
• Forte: An Interactive Visual Analytic Tool for Trust-Augmented Net Load Forecasting [0.6144680854063939]
  We present Forte, a visual analytics-based application to explore deep probabilistic net load forecasting models across various input variables. We discuss observations made using Forte and demonstrate the effectiveness of visualization techniques to provide valuable insights into the correlation between weather inputs and net load forecasts.
  arXiv  Detail & Related papers  (2023-11-10T22:15:11Z)
• Identifying Characteristics of the Agile Development Process That Impact User Satisfaction [3.3748063434734843]
  The purpose of this study is to identify the characteristics of Agile development processes that impact user satisfaction. No metrics conclusively indicate an improved user satisfaction, motivation of the development team, the ability to set appropriate work units, the appropriateness of work rules, and the improvement of code maintainability should be considered as they are correlated with improved user satisfaction.
  arXiv  Detail & Related papers  (2023-06-06T08:09:14Z)
• Consistency Analysis of ChatGPT [65.268245109828]
  This paper investigates the trustworthiness of ChatGPT and GPT-4 regarding logically consistent behaviour. Our findings suggest that while both models appear to show an enhanced language understanding and reasoning ability, they still frequently fall short of generating logically consistent predictions.
  arXiv  Detail & Related papers  (2023-03-11T01:19:01Z)
• On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspective [67.98821225810204]
  We evaluate the robustness of ChatGPT from the adversarial and out-of-distribution perspective. Results show consistent advantages on most adversarial and OOD classification and translation tasks. ChatGPT shows astounding performance in understanding dialogue-related texts.
  arXiv  Detail & Related papers  (2023-02-22T11:01:20Z)
• Factors Influencing Intention to use the COVID-19 Contact Tracing Application [0.0]
  Performance expectations, trust, and privacy all have an impact on app usage intention. Social impact, effort expectation, and facilitating conditions were not shown to be statistically significant.
  arXiv  Detail & Related papers  (2023-01-25T03:12:44Z)
• Proactive Detractor Detection Framework Based on Message-Wise Sentiment Analysis Over Customer Support Interactions [60.87845704495664]
  We propose a framework relying solely on chat-based customer support interactions for predicting the recommendation decision of individual users. For our case study, we analyzed a total number of 16.4k users and 48.7k customer support conversations within the financial vertical of a large e-commerce company in Latin America. Our results show that, with respective feature interpretability, it is possible to predict the likelihood of a user to recommend a product or service, based solely on the message-wise sentiment evolution of their CS conversations in a fully automated way.
  arXiv  Detail & Related papers  (2022-11-08T00:43:36Z)
• Personalized multi-faceted trust modeling to determine trust links in social media and its potential for misinformation management [61.88858330222619]
  We present an approach for predicting trust links between peers in social media. We propose a data-driven multi-faceted trust modeling which incorporates many distinct features for a comprehensive analysis. Illustrated in a trust-aware item recommendation task, we evaluate the proposed framework in the context of a large Yelp dataset.
  arXiv  Detail & Related papers  (2021-11-11T19:40:51Z)
• Is the User Enjoying the Conversation? A Case Study on the Impact on the Reward Function [0.0]
  We adopt deep neural networks that use distributed semantic representation learning for estimating user satisfaction in conversations. We show that the proposed hierarchical network outperforms state-of-the-art quality estimators. Applying these networks to infer the reward function in a Partial Observable Markov Decision Process yields to a great improvement in the task success rate.
  arXiv  Detail & Related papers  (2021-01-13T11:13:07Z)
• Unsatisfied Today, Satisfied Tomorrow: a simulation framework for performance evaluation of crowdsourcing-based network monitoring [68.8204255655161]
  We propose an empirical framework tailored to assess the quality of the detection of under-performing cells. The framework simulates both the processes of satisfaction surveys delivery and users satisfaction prediction. We use the simulation framework to test empirically the performance of under-performing sites detection in general scenarios.
  arXiv  Detail & Related papers  (2020-10-30T10:03:48Z)
• Knowing your FATE: Friendship, Action and Temporal Explanations for User Engagement Prediction on Social Apps [40.58156024231199]
  We study a novel problem of explainable user engagement prediction for social network Apps. We design an end-to-end neural framework, FATE, which incorporates three key factors that we identify to influence user engagement. FATE is based on a tensor-based graph neural network (GNN), LSTM and a mixture attention mechanism, which allows for (a) predictive explanations based on learned weights across different feature categories, (b) reduced network complexity, and (c) improved performance in both prediction accuracy and training/inference time.
  arXiv  Detail & Related papers  (2020-06-10T02:59:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.