Bringing Cognitive Augmentation to Web Browsing Accessibility
- URL: http://arxiv.org/abs/2012.03743v1
- Date: Mon, 7 Dec 2020 14:40:52 GMT
- Title: Bringing Cognitive Augmentation to Web Browsing Accessibility
- Authors: Alessandro Pina, Marcos Baez, Florian Daniel
- Abstract summary: We explore opportunities brought by cognitive augmentation to provide a more natural and accessible web browsing experience.
We develop a conceptual framework for supporting BVIP conversational web browsing needs.
We describe our early work and prototype that leverages that consider structural and content features only.
- Score: 69.62988485669146
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper we explore the opportunities brought by cognitive augmentation
to provide a more natural and accessible web browsing experience. We explore
these opportunities through \textit{conversational web browsing}, an emerging
interaction paradigm for the Web that enables blind and visually impaired users
(BVIP), as well as regular users, to access the contents and features of
websites through conversational agents. Informed by the literature, our
previous work and prototyping exercises, we derive a conceptual framework for
supporting BVIP conversational web browsing needs, to then focus on the
challenges of automatically providing this support, describing our early work
and prototype that leverage heuristics that consider structural and content
features only.
Related papers
- From Context to Action: Analysis of the Impact of State Representation and Context on the Generalization of Multi-Turn Web Navigation Agents [7.41862656697588]
This study aims to analyze the various contextual elements crucial to the functioning of web navigation agents.
We focus on the influence of interaction history and web page representation.
Our work highlights improved agent performance across out-of-distribution scenarios.
arXiv Detail & Related papers (2024-10-31T01:51:41Z) - Constraining Participation: Affordances of Feedback Features in Interfaces to Large Language Models [49.74265453289855]
Large language models (LLMs) are now accessible to anyone with a computer, a web browser, and an internet connection via browser-based interfaces.
This paper examines the affordances of interactive feedback features in ChatGPT's interface, analysing how they shape user input and participation in iteration.
arXiv Detail & Related papers (2024-08-27T13:50:37Z) - On the Multi-turn Instruction Following for Conversational Web Agents [83.51251174629084]
We introduce a new task of Conversational Web Navigation, which necessitates sophisticated interactions that span multiple turns with both the users and the environment.
We propose a novel framework, named self-reflective memory-augmented planning (Self-MAP), which employs memory utilization and self-reflection techniques.
arXiv Detail & Related papers (2024-02-23T02:18:12Z) - Improving In-Context Learning in Diffusion Models with Visual
Context-Modulated Prompts [83.03471704115786]
We introduce improved Prompt Diffusion (iPromptDiff) in this study.
iPromptDiff integrates an end-to-end trained vision encoder that converts visual context into an embedding vector.
We show that a diffusion-based vision foundation model, when equipped with this visual context-modulated text guidance and a standard ControlNet structure, exhibits versatility and robustness across a variety of training tasks.
arXiv Detail & Related papers (2023-12-03T14:15:52Z) - Exploring the Power of Creative AI Tools and Game-Based Methodologies
for Interactive Web-Based Programming [0.0]
Creative AI tools and game-based methodologies have emerged as potent instruments.
This chapter explores the potential of these tools for interactive web-based programming.
We examine their benefits, limitations, and real-world applications.
arXiv Detail & Related papers (2023-08-18T20:01:04Z) - Towards Ubiquitous Semantic Metaverse: Challenges, Approaches, and
Opportunities [68.03971716740823]
In recent years, ubiquitous semantic Metaverse has been studied to revolutionize immersive cyber-virtual experiences for augmented reality (AR) and virtual reality (VR) users.
This survey focuses on the representation and intelligence for the four fundamental system components in ubiquitous Metaverse.
arXiv Detail & Related papers (2023-07-13T11:14:46Z) - A Design Guideline to Overcome Web Accessibility Issues Challenged by
Visually Impaired Community in Sri Lanka [0.0]
Visual-impaired communities are one of the hindrances groups to accessing web content access in the world.
Five main problems including access limited by the impairment, usability issues due to lack of design, unavailability of visually impaired-friendly applications, lack of communication, and web navigation issues are the most dominant issues.
arXiv Detail & Related papers (2023-04-14T05:12:13Z) - The Semantic Reader Project: Augmenting Scholarly Documents through
AI-Powered Interactive Reading Interfaces [54.2590226904332]
We describe the Semantic Reader Project, a effort across multiple institutions to explore automatic creation of dynamic reading interfaces for research papers.
Ten prototype interfaces have been developed and more than 300 participants and real-world users have shown improved reading experiences.
We structure this paper around challenges scholars and the public face when reading research papers.
arXiv Detail & Related papers (2023-03-25T02:47:09Z) - Signifiers as a First-class Abstraction in Hypermedia Multi-Agent
Systems [0.6595290783361959]
We build on concepts and methods from Affordance Theory and Human-Computer Interaction to introduce signifiers as a first-class abstraction in Web-based Multi-Agent Systems.
We define a formal model for the contextual exposure of signifiers in hypermedia environments that aims to drive affordance exploitation.
arXiv Detail & Related papers (2023-02-14T10:54:46Z) - A Semantic Web Framework for Automated Smart Assistants: COVID-19 Case
Study [0.0]
Instant Expert is an open-source semantic web framework to build and integrate voice-enabled smart assistants.
The presented framework utilizes advanced web technologies to ensure reusability and reliability.
A use case for creating an informatory assistant for COVID-19 based on the Centers for Disease Control and Prevention (CDC) data is presented.
arXiv Detail & Related papers (2020-07-01T20:47:44Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.