Lessons from Usable ML Deployments and Application to Wind Turbine Monitoring

• URL: http://arxiv.org/abs/2312.02859v1
• Date: Tue, 5 Dec 2023 16:13:50 GMT
• Title: Lessons from Usable ML Deployments and Application to Wind Turbine Monitoring
• Authors: Alexandra Zytek, Wei-En Wang, Sofia Koukoura, and Kalyan Veeramachaneni
• Abstract summary: We call usable ML (one step beyond explainable ML) one step beyond explainable ML. We apply these lessons to the task of wind turbine monitoring. We hope to demonstrate the potential real-world impact of usable ML in the renewable energy domain.
• Score: 47.418845064441605
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Through past experiences deploying what we call usable ML (one step beyond explainable ML, including both explanations and other augmenting information) to real-world domains, we have learned three key lessons. First, many organizations are beginning to hire people who we call ``bridges'' because they bridge the gap between ML developers and domain experts, and these people fill a valuable role in developing usable ML applications. Second, a configurable system that enables easily iterating on usable ML interfaces during collaborations with bridges is key. Finally, there is a need for continuous, in-deployment evaluations to quantify the real-world impact of usable ML. Throughout this paper, we apply these lessons to the task of wind turbine monitoring, an essential task in the renewable energy domain. Turbine engineers and data analysts must decide whether to perform costly in-person investigations on turbines to prevent potential cases of brakepad failure, and well-tuned usable ML interfaces can aid with this decision-making process. Through the applications of our lessons to this task, we hope to demonstrate the potential real-world impact of usable ML in the renewable energy domain.

Related papers

• Generative AI-in-the-loop: Integrating LLMs and GPTs into the Next Generation Networks [11.509880721677156]
  Large language models (LLMs) have recently emerged, demonstrating near-human-level performance in cognitive tasks. We propose the concept of "generative AI-in-the-loop" We believe that combining LLMs and ML models allows both to leverage their respective capabilities and achieve better results than either model alone.
  arXiv  Detail & Related papers  (2024-06-06T17:25:07Z)
• Professional Insights into Benefits and Limitations of Implementing MLOps Principles [4.188979489866561]
  Machine Learning Operations (MLOps) has emerged as a set of practices that combines development, testing, and operations to deploy and maintain machine learning applications. We assess the benefits and limitations of using the MLOps principles in online supervised learning.
  arXiv  Detail & Related papers  (2024-03-19T19:40:41Z)
• Reliable, Adaptable, and Attributable Language Models with Retrieval [144.26890121729514]
  Parametric language models (LMs) are trained on vast amounts of web data. They face practical challenges such as hallucinations, difficulty in adapting to new data distributions, and a lack of verifiability. We advocate for retrieval-augmented LMs to replace parametric LMs as the next generation of LMs.
  arXiv  Detail & Related papers  (2024-03-05T18:22:33Z)
• From Summary to Action: Enhancing Large Language Models for Complex Tasks with Open World APIs [62.496139001509114]
  We introduce a novel tool invocation pipeline designed to control massive real-world APIs. This pipeline mirrors the human task-solving process, addressing complicated real-life user queries. Empirical evaluations of our Sum2Act pipeline on the ToolBench benchmark show significant performance improvements.
  arXiv  Detail & Related papers  (2024-02-28T08:42:23Z)
• A Multivocal Literature Review on the Benefits and Limitations of Automated Machine Learning Tools [9.69672653683112]
  We conducted a multivocal literature review, which allowed us to identify 54 sources from the academic literature and 108 sources from the grey literature reporting on AutoML benefits and limitations. Concerning the benefits, we highlight that AutoML tools can help streamline the core steps of ML. We highlight several limitations that may represent obstacles to the widespread adoption of AutoML.
  arXiv  Detail & Related papers  (2024-01-21T01:39:39Z)
• Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Models [76.99140362751787]
  We present NuInstruct, a novel dataset with 91K multi-view video-QA pairs across 17 subtasks. We also present BEV-InMLLM, an end-to-end method for efficiently deriving instruction-aware Bird's-Eye-View features.
  arXiv  Detail & Related papers  (2024-01-02T01:54:22Z)
• Knowledge Plugins: Enhancing Large Language Models for Domain-Specific Recommendations [50.81844184210381]
  We propose a general paradigm that augments large language models with DOmain-specific KnowledgE to enhance their performance on practical applications, namely DOKE. This paradigm relies on a domain knowledge extractor, working in three steps: 1) preparing effective knowledge for the task; 2) selecting the knowledge for each specific sample; and 3) expressing the knowledge in an LLM-understandable way.
  arXiv  Detail & Related papers  (2023-11-16T07:09:38Z)
• How Can Recommender Systems Benefit from Large Language Models: A Survey [82.06729592294322]
  Large language models (LLM) have shown impressive general intelligence and human-like capabilities. We conduct a comprehensive survey on this research direction from the perspective of the whole pipeline in real-world recommender systems.
  arXiv  Detail & Related papers  (2023-06-09T11:31:50Z)
• MLCopilot: Unleashing the Power of Large Language Models in Solving Machine Learning Tasks [31.733088105662876]
  We aim to bridge the gap between machine intelligence and human knowledge by introducing a novel framework. We showcase the possibility of extending the capability of LLMs to comprehend structured inputs and perform thorough reasoning for solving novel ML tasks.
  arXiv  Detail & Related papers  (2023-04-28T17:03:57Z)
• Machine Learning for a Sustainable Energy Future [8.421378169245827]
  We review recent advances in machine learning-driven energy research. We discuss and evaluate the latest advances in applying ML to the development of energy harvesting. We offer an outlook of potential research areas in the energy field that stand to further benefit from the application of ML.
  arXiv  Detail & Related papers  (2022-10-19T08:59:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.