TOM: A Development Platform For Wearable Intelligent Assistants
- URL: http://arxiv.org/abs/2407.15523v1
- Date: Mon, 22 Jul 2024 10:20:02 GMT
- Title: TOM: A Development Platform For Wearable Intelligent Assistants
- Authors: Nuwan Janaka, Shengdong Zhao, David Hsu, Sherisse Tan Jing Wen, Koh Chun Keat,
- Abstract summary: We introduce TOM, a conceptual architecture and software platform to support the development of intelligent wearable assistants.
TOM supports the recording and analysis of user interactions, integration of new devices, and the provision of assistance for various activities.
We showcase several proof-of-concept assistive services and discuss the challenges involved in developing such services.
- Score: 23.072788336462683
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Advanced digital assistants can significantly enhance task performance, reduce user burden, and provide personalized guidance to improve users' abilities. However, the development of such intelligent digital assistants presents a formidable challenge. To address this, we introduce TOM, a conceptual architecture and software platform (https://github.com/TOM-Platform) designed to support the development of intelligent wearable assistants that are contextually aware of both the user and the environment. This system was developed collaboratively with AR/MR researchers, HCI researchers, AI/Robotic researchers, and software developers, and it continues to evolve to meet the diverse requirements of these stakeholders. TOM facilitates the creation of intelligent assistive AR applications for daily activities and supports the recording and analysis of user interactions, integration of new devices, and the provision of assistance for various activities. Additionally, we showcase several proof-of-concept assistive services and discuss the challenges involved in developing such services.
Related papers
- The Ethics of Advanced AI Assistants [53.89899371095332]
This paper focuses on the opportunities and the ethical and societal risks posed by advanced AI assistants.
We define advanced AI assistants as artificial agents with natural language interfaces, whose function is to plan and execute sequences of actions on behalf of a user.
We consider the deployment of advanced assistants at a societal scale, focusing on cooperation, equity and access, misinformation, economic impact, the environment and how best to evaluate advanced AI assistants.
arXiv Detail & Related papers (2024-04-24T23:18:46Z) - Exploring Remote Hands-on Support for Collaborative Embedded Systems Development [3.9877913211157843]
This study explores the design space of remote support tools for embedded systems development.
We interviewed 12 seasoned embedded systems developers regarding their current remote work practices.
Our findings describe the support needs and information, coordination, and implementation challenges expressed by developers.
arXiv Detail & Related papers (2024-04-24T20:28:20Z) - Bridging Gaps, Building Futures: Advancing Software Developer Diversity and Inclusion Through Future-Oriented Research [50.545824691484796]
We present insights from SE researchers and practitioners on challenges and solutions regarding diversity and inclusion in SE.
We share potential utopian and dystopian visions of the future and provide future research directions and implications for academia and industry.
arXiv Detail & Related papers (2024-04-10T16:18:11Z) - A Design Space for Intelligent and Interactive Writing Assistants [55.9780345526642]
We explore five aspects of writing assistants: task, user, technology, interaction, and ecosystem.
Within each aspect, we define dimensions (i.e., fundamental components of an aspect) and codes (i.e., potential options for each dimension) by systematically reviewing 115 papers.
Our design space aims to offer researchers and designers a practical tool to navigate, comprehend, and compare the various possibilities of writing assistants.
arXiv Detail & Related papers (2024-03-21T04:03:16Z) - AgentScope: A Flexible yet Robust Multi-Agent Platform [66.64116117163755]
AgentScope is a developer-centric multi-agent platform with message exchange as its core communication mechanism.
The abundant syntactic tools, built-in agents and service functions, user-friendly interfaces for application demonstration and utility monitor, zero-code programming workstation, and automatic prompt tuning mechanism significantly lower the barriers to both development and deployment.
arXiv Detail & Related papers (2024-02-21T04:11:28Z) - Utilisation of open intent recognition models for customer support
intent detection [0.0]
Businesses have sought out new solutions to provide support and improve customer satisfaction.
Support solutions are advancing with technologies, including use of social media, Artificial Intelligence (AI), Machine Learning (ML) and remote device connectivity.
This study explored several approaches to accurately predict customers' intent using both labelled and unlabelled textual data.
arXiv Detail & Related papers (2023-07-31T10:20:16Z) - New Interaction Paradigm for Complex EDA Software Leveraging GPT [4.397804186778722]
An artificial intelligence (AI) interaction assist plugin for EDA software named SmartonAl is developed here.
SmartonAI is inspired by the HuggingGPT framework and employs large language models, such as GPT and BERT, to facilitate task planning and execution.
Our preliminary results demonstrate that SmartonAI can significantly streamline the PCB design process by simplifying complex commands into intuitive language-based interactions.
arXiv Detail & Related papers (2023-07-27T09:53:02Z) - A Large-Scale Survey on the Usability of AI Programming Assistants:
Successes and Challenges [23.467373994306524]
In practice, developers do not accept AI programming assistants' initial suggestions at a high frequency.
To understand developers' practices while using these tools, we administered a survey to a large population of developers.
We found that developers are most motivated to use AI programming assistants because they help developers reduce key-strokes, finish programming tasks quickly, and recall syntax.
We also found the most important reasons why developers do not use these tools are because these tools do not output code that addresses certain functional or non-functional requirements.
arXiv Detail & Related papers (2023-03-30T03:21:53Z) - Towards Human-Bot Collaborative Software Architecting with ChatGPT [7.50312929275194]
Software Development Bots (DevBots) trained on large language models can help synergise architects' knowledge with artificially intelligent decision support.
ChatGPT is a disruptive technology not primarily introduced for software engineering.
We detail a case study that involves collaboration between a novice software architect and ChatGPT for architectural analysis, synthesis, and evaluation of a services-driven software application.
arXiv Detail & Related papers (2023-02-26T16:32:16Z) - Towards an AI assistant for human grid operators [59.535699822923]
Power systems are becoming more complex to operate in the digital age.
Real-time decision-making is getting more challenging as the human operator has to deal with more information.
There is a great need for rethinking the human-machine interface under more unified and interactive frameworks.
arXiv Detail & Related papers (2020-12-03T16:12:58Z) - Watch-And-Help: A Challenge for Social Perception and Human-AI
Collaboration [116.28433607265573]
We introduce Watch-And-Help (WAH), a challenge for testing social intelligence in AI agents.
In WAH, an AI agent needs to help a human-like agent perform a complex household task efficiently.
We build VirtualHome-Social, a multi-agent household environment, and provide a benchmark including both planning and learning based baselines.
arXiv Detail & Related papers (2020-10-19T21:48:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.