Escalation Prediction using Feature Engineering: Addressing Support Ticket Escalations within IBM's Ecosystem

• URL: http://arxiv.org/abs/2010.06390v1
• Date: Mon, 12 Oct 2020 07:06:52 GMT
• Title: Escalation Prediction using Feature Engineering: Addressing Support Ticket Escalations within IBM's Ecosystem
• Authors: Lloyd Montgomery
• Abstract summary: This thesis provides a step towards simplifying the job for support analysts and managers, particularly in predicting the risk of escalating support tickets. Support analysts' expert knowledge about their customers was translated into features of a support ticket model to be implemented into a Machine Learning model to predict support ticket escalations. The Machine Learning model was trained and evaluated on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 79.9% and an 80.8% reduction in the workload for support analysts looking to identify support tickets at risk of escalation.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large software organizations handle many customer support issues every day in the form of bug reports, feature requests, and general misunderstandings as submitted by customers. Strategies to gather, analyze, and negotiate requirements are complemented by efforts to manage customer input after products have been deployed. For the latter, support tickets are key in allowing customers to submit their issues, bug reports, and feature requests. Whenever insufficient attention is given to support issues, there is a chance customers will escalate their issues, and escalation to management is time-consuming and expensive, especially for large organizations managing hundreds of customers and thousands of support tickets. This thesis provides a step towards simplifying the job for support analysts and managers, particularly in predicting the risk of escalating support tickets. In a field study at our large industrial partner, IBM, a design science methodology was employed to characterize the support process and data available to IBM analysts in managing escalations. Through iterative cycles of design and evaluation, support analysts' expert knowledge about their customers was translated into features of a support ticket model to be implemented into a Machine Learning model to predict support ticket escalations. The Machine Learning model was trained and evaluated on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 79.9% and an 80.8% reduction in the workload for support analysts looking to identify support tickets at risk of escalation. The features developed in the Support Ticket Model are designed to serve as a starting place for organizations interested in implementing the model to predict support ticket escalations, and for future researchers to build on to advance research in Escalation Prediction.

Related papers

• AI-based Classification of Customer Support Tickets: State of the Art and Implementation with AutoML [0.0]
  This research aims to test the applicability of automated machine learning (AutoML) as a technology to train a machine learning model (ML model) that can classify support tickets. The model evaluation conducted in this research shows that AutoML can be used to train ML models with good classification performance.
  arXiv  Detail & Related papers  (2024-06-03T21:13:02Z)
• Utilisation of open intent recognition models for customer support intent detection [0.0]
  Businesses have sought out new solutions to provide support and improve customer satisfaction. Support solutions are advancing with technologies, including use of social media, Artificial Intelligence (AI), Machine Learning (ML) and remote device connectivity. This study explored several approaches to accurately predict customers' intent using both labelled and unlabelled textual data.
  arXiv  Detail & Related papers  (2023-07-31T10:20:16Z)
• Learning Personalized Decision Support Policies [56.949897454209186]
  $texttModiste$ is an interactive tool to learn personalized decision support policies. We find that personalized policies outperform offline policies, and, in the cost-aware setting, reduce the incurred cost with minimal degradation to performance.
  arXiv  Detail & Related papers  (2023-04-13T17:53:34Z)
• SmartBook: AI-Assisted Situation Report Generation for Intelligence Analysts [55.73424958012229]
  This work identifies intelligence analysts' practices and preferences for AI assistance in situation report generation. We introduce SmartBook, an automated framework designed to generate situation reports from large volumes of news data. Our comprehensive evaluation of SmartBook, encompassing a user study alongside a content review with an editing study, reveals SmartBook's effectiveness in generating accurate and relevant situation reports.
  arXiv  Detail & Related papers  (2023-03-25T03:03:00Z)
• Assisting Human Decisions in Document Matching [52.79491990823573]
  We devise a proxy matching task that allows us to evaluate which kinds of assistive information improve decision makers' performance. We find that providing black-box model explanations reduces users' accuracy on the matching task. On the other hand, custom methods that are designed to closely attend to some task-specific desiderata are found to be effective in improving user performance.
  arXiv  Detail & Related papers  (2023-02-16T17:45:20Z)
• PAL: Persona-Augmented Emotional Support Conversation Generation [54.069321178816686]
  Due to the lack of human resources for mental health support, there is an increasing demand for employing conversational agents for support. Recent work has demonstrated the effectiveness of dialogue models in providing emotional support. We propose a framework for dynamically inferring and modeling seekers' persona.
  arXiv  Detail & Related papers  (2022-12-19T04:12:54Z)
• Proactive Detractor Detection Framework Based on Message-Wise Sentiment Analysis Over Customer Support Interactions [60.87845704495664]
  We propose a framework relying solely on chat-based customer support interactions for predicting the recommendation decision of individual users. For our case study, we analyzed a total number of 16.4k users and 48.7k customer support conversations within the financial vertical of a large e-commerce company in Latin America. Our results show that, with respective feature interpretability, it is possible to predict the likelihood of a user to recommend a product or service, based solely on the message-wise sentiment evolution of their CS conversations in a fully automated way.
  arXiv  Detail & Related papers  (2022-11-08T00:43:36Z)
• TaDaa: real time Ticket Assignment Deep learning Auto Advisor for customer support, help desk, and issue ticketing systems [0.0]
  The project provides functionality to 1) assign an issue to the correct group, 2) assign an issue to the best resolver, and 3) provide the most relevant previously solved tickets to resolvers. We leverage one ticketing system sample dataset, with over 3k+ groups and over 10k+ resolvers to obtain a 95.2% top 3 accuracy on group suggestions and a 79.0% top 5 accuracy on resolver suggestions.
  arXiv  Detail & Related papers  (2022-07-18T18:08:34Z)
• Towards Emotional Support Dialog Systems [61.58828606097423]
  We define the Emotional Support Conversation task and propose an ESC Framework, which is grounded on the Helping Skills Theory. We construct an Emotion Support Conversation dataset (ESConv) with rich annotation (especially support strategy) in a help-seeker and supporter mode. We evaluate state-of-the-art dialog models with respect to the ability to provide emotional support.
  arXiv  Detail & Related papers  (2021-06-02T13:30:43Z)
• System Design for a Data-driven and Explainable Customer Sentiment Monitor [2.490457152391676]
  We present a framework for a data-driven decision support system which combines IoT and enterprise data to model customer sentiment. The framework is applied in a real-world case study with a major medical device manufacturer.
  arXiv  Detail & Related papers  (2021-01-11T18:29:50Z)
• Customer Support Ticket Escalation Prediction using Feature Engineering [0.0]
  We use a design science research methodology to characterize the support process and data available to IBM analysts in managing escalations. We then implement these features into a machine learning model to predict support ticket escalations. We trained and evaluated our machine learning model on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 87.36% and an 88.23% reduction in the workload.
  arXiv  Detail & Related papers  (2020-10-10T15:49:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.