Making sense of AI systems development

• URL: http://arxiv.org/abs/2408.04311v1
• Date: Thu, 8 Aug 2024 08:46:32 GMT
• Title: Making sense of AI systems development
• Authors: Mateusz Dolata, Kevin Crowston,
• Abstract summary: We describe challenges in modern AI-based systems development that emerged in projects carried out by IBM and client companies. Many issues bear upon the current-generation AI's inherent characteristics. Those characteristics increase the complexity of the projects and call for balanced mindfulness to avoid unexpected problems.
• Score: 3.6141428739228894
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: We identify and describe episodes of sensemaking around challenges in modern AI-based systems development that emerged in projects carried out by IBM and client companies. All projects used IBM Watson as the development platform for building tailored AI-based solutions to support workers or customers of the client companies. Yet, many of the projects turned out to be significantly more challenging than IBM and its clients had expected. The analysis reveals that project members struggled to establish reliable meanings about the technology, the project, context, and data to act upon. The project members report multiple aspects of the projects that they were not expecting to need to make sense of yet were problematic. Many issues bear upon the current-generation AI's inherent characteristics, such as dependency on large data sets and continuous improvement as more data becomes available. Those characteristics increase the complexity of the projects and call for balanced mindfulness to avoid unexpected problems.

Related papers

• Collaborative AI in Sentiment Analysis: System Architecture, Data Prediction and Deployment Strategies [3.3374611485861116]
  Large language model (LLM) based artificial intelligence technologies have been a game-changer, particularly in sentiment analysis. However, integrating diverse AI models for processing complex multimodal data and the associated high costs of feature extraction presents significant challenges. This study introduces a collaborative AI framework designed to efficiently distribute and resolve tasks across various AI systems.
  arXiv  Detail & Related papers  (2024-10-17T06:14:34Z)
• Data Analysis in the Era of Generative AI [56.44807642944589]
  This paper explores the potential of AI-powered tools to reshape data analysis, focusing on design considerations and challenges. We explore how the emergence of large language and multimodal models offers new opportunities to enhance various stages of data analysis workflow. We then examine human-centered design principles that facilitate intuitive interactions, build user trust, and streamline the AI-assisted analysis workflow across multiple apps.
  arXiv  Detail & Related papers  (2024-09-27T06:31:03Z)
• Project Archetypes: A Blessing and a Curse for AI Development [3.2157163136267943]
  The development of applications using machine learning and artificial intelligence provides a context in which existing archetypes might outdate and need to be questioned, adapted, or replaced. We analyzed 36 interviews from 21 projects between IBM Watson and client companies and identified four project archetypes members initially used to understand the projects. We then derive a new project archetype, cognitive computing project, from the interviews. It can inform future development projects based on AI-development platforms.
  arXiv  Detail & Related papers  (2024-08-08T08:52:19Z)
• On the Challenges and Opportunities in Generative AI [135.2754367149689]
  We argue that current large-scale generative AI models do not sufficiently address several fundamental issues that hinder their widespread adoption across domains. In this work, we aim to identify key unresolved challenges in modern generative AI paradigms that should be tackled to further enhance their capabilities, versatility, and reliability.
  arXiv  Detail & Related papers  (2024-02-28T15:19:33Z)
• Dealing with Data for RE: Mitigating Challenges while using NLP and Generative AI [2.9189409618561966]
  Book chapter explores the evolving landscape of Software Engineering in general, and Requirements Engineering (RE) in particular. We discuss challenges that arise while integrating Natural Language Processing (NLP) and generative AI into enterprise-critical software systems. Book provides practical insights, solutions, and examples to equip readers with the knowledge and tools necessary.
  arXiv  Detail & Related papers  (2024-02-26T19:19:47Z)
• Development in times of hype: How freelancers explore Generative AI? [0.0]
  Generative AI presents unique challenges to developers who have not previously engaged with it. We identify multiple challenges associated with developing solutions based on generative AI. We propose Software Engineering for Generative AI (SE4GenAI) and Hype-Induced Software Engineering (HypeSE) as areas where the software engineering community can provide effective guidance.
  arXiv  Detail & Related papers  (2024-01-11T09:49:50Z)
• AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challenges [60.56413461109281]
  Artificial Intelligence for IT operations (AIOps) aims to combine the power of AI with the big data generated by IT Operations processes. We discuss in depth the key types of data emitted by IT Operations activities, the scale and challenges in analyzing them, and where they can be helpful. We categorize the key AIOps tasks as - incident detection, failure prediction, root cause analysis and automated actions.
  arXiv  Detail & Related papers  (2023-04-10T15:38:12Z)
• Data-centric AI: Perspectives and Challenges [51.70828802140165]
  Data-centric AI (DCAI) advocates a fundamental shift from model advancements to ensuring data quality and reliability. We bring together three general missions: training data development, inference data development, and data maintenance.
  arXiv  Detail & Related papers  (2023-01-12T05:28:59Z)
• The Future of Consumer Edge-AI Computing [58.445652425379855]
  Deep Learning has rapidly infiltrated the consumer end, mainly thanks to hardware acceleration across devices. As we look towards the future, it is evident that isolated hardware will be insufficient. We introduce a novel paradigm centered around EdgeAI-Hub devices, designed to reorganise and optimise compute resources and data access at the consumer edge.
  arXiv  Detail & Related papers  (2022-10-19T12:41:47Z)
• Transient Information Adaptation of Artificial Intelligence: Towards Sustainable Data Processes in Complex Projects [0.0]
  Large scale projects increasingly operate in complicated settings whilst drawing on an array of complex data-points. 90% of megaprojects globally fail to achieve their planned objectives. Renewed interest in the concept of Artificial Intelligence seeks to enhance project managers cognitive capacity through the project lifecycle.
  arXiv  Detail & Related papers  (2021-03-27T22:28:52Z)
• Empowering Things with Intelligence: A Survey of the Progress, Challenges, and Opportunities in Artificial Intelligence of Things [98.10037444792444]
  We show how AI can empower the IoT to make it faster, smarter, greener, and safer. First, we present progress in AI research for IoT from four perspectives: perceiving, learning, reasoning, and behaving. Finally, we summarize some promising applications of AIoT that are likely to profoundly reshape our world.
  arXiv  Detail & Related papers  (2020-11-17T13:14:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.