Identifying Crucial Objects in Blind and Low-Vision Individuals' Navigation

• URL: http://arxiv.org/abs/2408.13175v1
• Date: Fri, 23 Aug 2024 15:50:50 GMT
• Title: Identifying Crucial Objects in Blind and Low-Vision Individuals' Navigation
• Abstract summary: This paper presents a curated list of 90 objects essential for the navigation of blind and low-vision (BLV) individuals. We develop the initial list by analyzing 21 publicly available videos featuring BLV individuals navigating various settings. A subsequent analysis reveals that most contemporary datasets used to train recent computer vision models contain only a small subset of the objects in our proposed list.
• Score: 4.413331329339185
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presents a curated list of 90 objects essential for the navigation of blind and low-vision (BLV) individuals, encompassing road, sidewalk, and indoor environments. We develop the initial list by analyzing 21 publicly available videos featuring BLV individuals navigating various settings. Then, we refine the list through feedback from a focus group study involving blind, low-vision, and sighted companions of BLV individuals. A subsequent analysis reveals that most contemporary datasets used to train recent computer vision models contain only a small subset of the objects in our proposed list. Furthermore, we provide detailed object labeling for these 90 objects across 31 video segments derived from the original 21 videos. Finally, we make the object list, the 21 videos, and object labeling in the 31 video segments publicly available. This paper aims to fill the existing gap and foster the development of more inclusive and effective navigation aids for the BLV community.

Related papers

• Report of the 8th LSVOS Challenge: Complex and Multimodal Video Object Segmentation [123.08518673784818]
  This report summarizes the 8th Large-scale Video Object (LSVOS) Challenge, held in conjunction with ECCV 2026.<n>The challenge evaluates video segmentation in three complementary settings: complex semi-supervised video object segmentation on MOSEv2, text-guided referring video object segmentation on MeViSv2-Text, and audio-guided referring video object segmentation on MeViSv2-Audio.
  arXiv  Detail & Related papers  (2026-09-05T13:11:38Z)
• Focus Where It Counts: A Salience-Driven Vision-Language Model for Low Vision Assistance [18.85523453781126]
  We propose a salience-driven captioning framework that prioritizes scene elements according to their importance for human-centered assistance.<n>We build salience-aware datasets verified by low vision participants, propose Salience-LLaVA to describe objects in the order of importance, introduce SCMI to evaluate ordering accuracy, and deploy the system on assistive glasses to demonstrate real-world practicality.
  arXiv  Detail & Related papers  (2026-08-28T11:35:00Z)
• Report of the 5th PVUW Challenge: Towards More Diverse Modalities in Pixel-Level Understanding [202.7892709083317]
  This report summarizes the objectives, datasets, and top-performing methodologies of the 2026 Pixel-level Video Understanding in the Wild (PVUW) Challenge.<n>The 2026 edition features three specialized tracks: the MOSE track for tracking objects within densely cluttered and severely occluded scenarios; the MeViS-Text track for localizing targets via motion-focused linguistic expressions; and the newly inaugurated MeViS-Audio track, which pioneers acoustic-driven object segmentation.
  arXiv  Detail & Related papers  (2026-04-28T18:14:18Z)
• Show Me When and Where: Towards Referring Video Object Segmentation in the Wild [98.87931411432106]
  In this work, we introduce a new setting towards in-the-wild RVOS.<n>Our new benchmark challenges RVOS methods to show not only where but also when objects appear in videos.<n>Our YoURVOS dataset offers an imperative benchmark, which will push forward the advancement of RVOS methods for practical applications.
  arXiv  Detail & Related papers  (2026-03-15T09:30:33Z)
• Open-World Object Counting in Videos [55.2480439325792]
  We introduce a new task of open-world object counting in videos.<n>The objective is to enumerate all the unique instances of the target objects in the video.<n>We introduce a model, CountVid, for this task.
  arXiv  Detail & Related papers  (2025-06-18T11:35:30Z)
• GuideDog: A Real-World Egocentric Multimodal Dataset for Blind and Low-Vision Accessibility-Aware Guidance [18.467461615621872]
  Mobility remains a significant challenge for the 2.2 billion people worldwide affected by blindness and low vision (BLV) We introduce GuideDog, a novel accessibility-aware guide dataset containing 22K image-description pairs. We also develop GuideDogQA, a subset of 818 samples featuring multiple-choice questions designed to evaluate fine-grained visual perception capabilities.
  arXiv  Detail & Related papers  (2025-03-17T05:43:40Z)
• VideoA11y: Method and Dataset for Accessible Video Description [4.081116465356645]
  Video descriptions are crucial for blind and low vision (BLV) users to access visual content. We introduce VideoA11y, an approach that leverages multimodal large language models (MLLMs) and video accessibility guidelines to generate descriptions tailored for BLV individuals. Using this method, we have curated VideoA11y-40K, the largest and most comprehensive dataset of 40,000 videos described for BLV users.
  arXiv  Detail & Related papers  (2025-02-27T19:44:31Z)
• DivScene: Benchmarking LVLMs for Object Navigation with Diverse Scenes and Objects [84.73092715537364]
  In this paper, we study a new task of navigating to diverse target objects in a large number of scene types. We build an end-to-end embodied agent, NatVLM, by fine-tuning a Large Vision Language Model (LVLM) through imitation learning. Our agent achieves a success rate that surpasses GPT-4o by over 20%.
  arXiv  Detail & Related papers  (2024-10-03T17:49:28Z)
• A New People-Object Interaction Dataset and NVS Benchmarks [16.909004722367644]
  We introduce a new people-object interaction dataset that comprises 38 series of 30-view multi-person or single-person RGB-D video sequences. Video sequences are captured by 30 Kinect Azures, uniformly surrounding the scene, each in 4K resolution 25 FPS, and lasting for 1$sim$19 seconds.
  arXiv  Detail & Related papers  (2024-09-03T08:54:15Z)
• A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigation [4.413331329339185]
  This paper introduces a dataset for improving real-time object recognition systems to aid blind and low-vision (BLV) individuals in navigation tasks. The dataset comprises 21 videos of BLV individuals navigating outdoor spaces, and a taxonomy of 90 objects crucial for BLV navigation, refined through a focus group study.
  arXiv  Detail & Related papers  (2024-07-23T18:19:27Z)
• 360VOTS: Visual Object Tracking and Segmentation in Omnidirectional Videos [16.372814014632944]
  We propose a comprehensive dataset and benchmark that incorporates a new component called omnidirectional video object segmentation (360VOS) 360VOS dataset includes 290 sequences accompanied by dense pixel-wise masks and covers a broader range of target categories. We benchmark state-of-the-art approaches and demonstrate the effectiveness of our proposed 360 tracking framework and training dataset.
  arXiv  Detail & Related papers  (2024-04-22T07:54:53Z)
• Panonut360: A Head and Eye Tracking Dataset for Panoramic Video [0.0]
  We present a head and eye tracking dataset involving 50 users watching 15 panoramic videos. The dataset provides details on the viewport and gaze attention locations of users. Our analysis reveals a consistent downward offset in gaze fixations relative to the Field of View.
  arXiv  Detail & Related papers  (2024-03-26T13:54:52Z)
• A Density-Guided Temporal Attention Transformer for Indiscernible Object Counting in Underwater Video [27.329015161325962]
  Indiscernible object counting, which aims to count the number of targets that are blended with respect to their surroundings, has been a challenge. We propose a large-scale dataset called YoutubeFish-35, which contains a total of 35 sequences of high-definition videos. We propose TransVidCount, a new strong baseline that combines density and regression branches along the temporal domain in a unified framework.
  arXiv  Detail & Related papers  (2024-03-06T04:54:00Z)
• Tracking Anything in High Quality [63.63653185865726]
  HQTrack is a framework for High Quality Tracking anything in videos. It consists of a video multi-object segmenter (VMOS) and a mask refiner (MR)
  arXiv  Detail & Related papers  (2023-07-26T06:19:46Z)
• ASOD60K: Audio-Induced Salient Object Detection in Panoramic Videos [79.05486554647918]
  We propose PV-SOD, a new task that aims to segment salient objects from panoramic videos. In contrast to existing fixation-level or object-level saliency detection tasks, we focus on multi-modal salient object detection (SOD) We collect the first large-scale dataset, named ASOD60K, which contains 4K-resolution video frames annotated with a six-level hierarchy.
  arXiv  Detail & Related papers  (2021-07-24T15:14:20Z)
• A Survey on Deep Learning Technique for Video Segmentation [147.0767454918527]
  Video segmentation plays a critical role in a broad range of practical applications. Deep learning based approaches have been dedicated to video segmentation and delivered compelling performance.
  arXiv  Detail & Related papers  (2021-07-02T15:51:07Z)
• APES: Audiovisual Person Search in Untrimmed Video [87.4124877066541]
  We present the Audiovisual Person Search dataset (APES) APES contains over 1.9K identities labeled along 36 hours of video. A key property of APES is that it includes dense temporal annotations that link faces to speech segments of the same identity.
  arXiv  Detail & Related papers  (2021-06-03T08:16:42Z)
• The IKEA ASM Dataset: Understanding People Assembling Furniture through Actions, Objects and Pose [108.21037046507483]
  IKEA ASM is a three million frame, multi-view, furniture assembly video dataset that includes depth, atomic actions, object segmentation, and human pose. We benchmark prominent methods for video action recognition, object segmentation and human pose estimation tasks on this challenging dataset. The dataset enables the development of holistic methods, which integrate multi-modal and multi-view data to better perform on these tasks.
  arXiv  Detail & Related papers  (2020-07-01T11:34:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.