Customer Support Ticket Escalation Prediction using Feature Engineering

• URL: http://arxiv.org/abs/2010.06145v1
• Date: Sat, 10 Oct 2020 15:49:43 GMT
• Title: Customer Support Ticket Escalation Prediction using Feature Engineering
• Authors: Lloyd Montgomery, Daniela Damian, Tyson Bulmer, Shaikh Quader
• Abstract summary: We use a design science research methodology to characterize the support process and data available to IBM analysts in managing escalations. We then implement these features into a machine learning model to predict support ticket escalations. We trained and evaluated our machine learning model on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 87.36% and an 88.23% reduction in the workload.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Understanding and keeping the customer happy is a central tenet of requirements engineering. Strategies to gather, analyze, and negotiate requirements are complemented by efforts to manage customer input after products have been deployed. For the latter, support tickets are key in allowing customers to submit their issues, bug reports, and feature requests. If insufficient attention is given to support issues, however, their escalation to management becomes time-consuming and expensive, especially for large organizations managing hundreds of customers and thousands of support tickets. Our work provides a step towards simplifying the job of support analysts and managers, particularly in predicting the risk of escalating support tickets. In a field study at our large industrial partner, IBM, we used a design science research methodology to characterize the support process and data available to IBM analysts in managing escalations. We then implemented these features into a machine learning model to predict support ticket escalations. We trained and evaluated our machine learning model on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 87.36% and an 88.23% reduction in the workload for support analysts looking to identify support tickets at risk of escalation. Finally, in addition to these research evaluation activities, we compared the performance of our support ticket model with that of a model developed with no feature engineering; the support ticket model features outperformed the non-engineered model. The artifacts created in this research are designed to serve as a starting place for organizations interested in predicting support ticket escalations, and for future researchers to build on to advance research in escalation prediction.

Related papers

• WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Tasks [85.95607119635102]
  Large language models (LLMs) can mimic human-like intelligence. WorkArena++ is designed to evaluate the planning, problem-solving, logical/arithmetic reasoning, retrieval, and contextual understanding abilities of web agents.
  arXiv  Detail & Related papers  (2024-07-07T07:15:49Z)
• AI-based Classification of Customer Support Tickets: State of the Art and Implementation with AutoML [0.0]
  This research aims to test the applicability of automated machine learning (AutoML) as a technology to train a machine learning model (ML model) that can classify support tickets. The model evaluation conducted in this research shows that AutoML can be used to train ML models with good classification performance.
  arXiv  Detail & Related papers  (2024-06-03T21:13:02Z)
• Utilisation of open intent recognition models for customer support intent detection [0.0]
  Businesses have sought out new solutions to provide support and improve customer satisfaction. Support solutions are advancing with technologies, including use of social media, Artificial Intelligence (AI), Machine Learning (ML) and remote device connectivity. This study explored several approaches to accurately predict customers' intent using both labelled and unlabelled textual data.
  arXiv  Detail & Related papers  (2023-07-31T10:20:16Z)
• Let's Verify Step by Step [73.58107073356732]
  We show that process supervision significantly outperforms outcome supervision for training models to solve problems. Our model solves 78% of problems from a representative subset of the MATH test set. We also release PRM800K, the complete dataset of 800,000 step-level human feedback labels used to train our best reward model.
  arXiv  Detail & Related papers  (2023-05-31T17:24:00Z)
• Learning Personalized Decision Support Policies [56.949897454209186]
  $texttModiste$ is an interactive tool to learn personalized decision support policies. We find that personalized policies outperform offline policies, and, in the cost-aware setting, reduce the incurred cost with minimal degradation to performance.
  arXiv  Detail & Related papers  (2023-04-13T17:53:34Z)
• Assisting Human Decisions in Document Matching [52.79491990823573]
  We devise a proxy matching task that allows us to evaluate which kinds of assistive information improve decision makers' performance. We find that providing black-box model explanations reduces users' accuracy on the matching task. On the other hand, custom methods that are designed to closely attend to some task-specific desiderata are found to be effective in improving user performance.
  arXiv  Detail & Related papers  (2023-02-16T17:45:20Z)
• PAL: Persona-Augmented Emotional Support Conversation Generation [54.069321178816686]
  Due to the lack of human resources for mental health support, there is an increasing demand for employing conversational agents for support. Recent work has demonstrated the effectiveness of dialogue models in providing emotional support. We propose a framework for dynamically inferring and modeling seekers' persona.
  arXiv  Detail & Related papers  (2022-12-19T04:12:54Z)
• TaDaa: real time Ticket Assignment Deep learning Auto Advisor for customer support, help desk, and issue ticketing systems [0.0]
  The project provides functionality to 1) assign an issue to the correct group, 2) assign an issue to the best resolver, and 3) provide the most relevant previously solved tickets to resolvers. We leverage one ticketing system sample dataset, with over 3k+ groups and over 10k+ resolvers to obtain a 95.2% top 3 accuracy on group suggestions and a 79.0% top 5 accuracy on resolver suggestions.
  arXiv  Detail & Related papers  (2022-07-18T18:08:34Z)
• A Survey on Proactive Customer Care: Enabling Science and Steps to Realize it [10.85017740334476]
  We have analyzed the various building blocks needed to enable an AI-driven predictive maintenance use-case. Our survey can serve as a template needed to design a successful predictive maintenance use-case.
  arXiv  Detail & Related papers  (2021-10-11T05:56:03Z)
• Escalation Prediction using Feature Engineering: Addressing Support Ticket Escalations within IBM's Ecosystem [0.0]
  This thesis provides a step towards simplifying the job for support analysts and managers, particularly in predicting the risk of escalating support tickets. Support analysts' expert knowledge about their customers was translated into features of a support ticket model to be implemented into a Machine Learning model to predict support ticket escalations. The Machine Learning model was trained and evaluated on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 79.9% and an 80.8% reduction in the workload for support analysts looking to identify support tickets at risk of escalation.
  arXiv  Detail & Related papers  (2020-10-12T07:06:52Z)
• Conversations with Documents. An Exploration of Document-Centered Assistance [55.60379539074692]
  Document-centered assistance, for example, to help an individual quickly review a document, has seen less significant progress. We present a survey to understand the space of document-centered assistance and the capabilities people expect in this scenario. We present a set of initial machine learned models that show that (a) we can accurately detect document-centered questions, and (b) we can build reasonably accurate models for answering such questions.
  arXiv  Detail & Related papers  (2020-01-27T17:10:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.