A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigation

• URL: http://arxiv.org/abs/2407.16777v1
• Date: Tue, 23 Jul 2024 18:19:27 GMT
• Title: A Dataset for Crucial Object Recognition in Blind and Low-Vision Individuals' Navigation
• Abstract summary: This paper introduces a dataset for improving real-time object recognition systems to aid blind and low-vision (BLV) individuals in navigation tasks. The dataset comprises 21 videos of BLV individuals navigating outdoor spaces, and a taxonomy of 90 objects crucial for BLV navigation, refined through a focus group study.
• Score: 4.413331329339185
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper introduces a dataset for improving real-time object recognition systems to aid blind and low-vision (BLV) individuals in navigation tasks. The dataset comprises 21 videos of BLV individuals navigating outdoor spaces, and a taxonomy of 90 objects crucial for BLV navigation, refined through a focus group study. We also provide object labeling for the 90 objects across 31 video segments created from the 21 videos. A deeper analysis reveals that most contemporary datasets used in training computer vision models contain only a small subset of the taxonomy in our dataset. Preliminary evaluation of state-of-the-art computer vision models on our dataset highlights shortcomings in accurately detecting key objects relevant to BLV navigation, emphasizing the need for specialized datasets. We make our dataset publicly available, offering valuable resources for developing more inclusive navigation systems for BLV individuals.

Related papers

• Object Recognition Datasets and Challenges: A Review [5.638005500131518]
  We provide a detailed analysis of datasets in the highly investigated object recognition areas.<n>We present an overview of the prominent object recognition benchmarks and competitions.<n>All introduced datasets and challenges can be found online at.com/AbtinDjavadifar/ORDC.
  arXiv  Detail & Related papers  (2025-07-30T03:56:37Z)
• DivScene: Towards Open-Vocabulary Object Navigation with Large Vision Language Models in Diverse Scenes [76.24687327731031]
  We first study the challenge of open-vocabulary object navigation by introducing DivScene.<n>Our dataset provides a much greater diversity of target objects and scene types than existing datasets.<n>We fine-tuned LVLMs to predict the next action with CoT explanations.
  arXiv  Detail & Related papers  (2024-10-03T17:49:28Z)
• Identifying Crucial Objects in Blind and Low-Vision Individuals' Navigation [4.413331329339185]
  This paper presents a curated list of 90 objects essential for the navigation of blind and low-vision (BLV) individuals. We develop the initial list by analyzing 21 publicly available videos featuring BLV individuals navigating various settings. A subsequent analysis reveals that most contemporary datasets used to train recent computer vision models contain only a small subset of the objects in our proposed list.
  arXiv  Detail & Related papers  (2024-08-23T15:50:50Z)
• VANP: Learning Where to See for Navigation with Self-Supervised Vision-Action Pre-Training [8.479135285935113]
  Humans excel at efficiently navigating through crowds without collision by focusing on specific visual regions relevant to navigation. Most robotic visual navigation methods rely on deep learning models pre-trained on vision tasks, which prioritize salient objects. We propose a Self-Supervised Vision-Action Model for Visual Navigation Pre-Training (VANP)
  arXiv  Detail & Related papers  (2024-03-12T22:33:08Z)
• A Landmark-Aware Visual Navigation Dataset [6.1190419149081245]
  We present a Landmark-Aware Visual Navigation dataset to allow for supervised learning of human-centric exploration policies and map building. We collect RGBD observation and human point-click pairs as a human annotator explores virtual and real-world environments. Our dataset covers a wide spectrum of scenes, including rooms in indoor environments, as well as walkways outdoors.
  arXiv  Detail & Related papers  (2024-02-22T04:43:20Z)
• The Visual Experience Dataset: Over 200 Recorded Hours of Integrated Eye Movement, Odometry, and Egocentric Video [0.9644266648330361]
  The Visual Experience dataset consists of 717 sessions, recorded by 58 observers ranging from 6-49 years old. The VEDB's potential applications are vast, including improving video tracking methodologies, assessing image statistics, and refining deep neural networks for scene and activity recognition.
  arXiv  Detail & Related papers  (2024-02-15T10:34:28Z)
• SynDrone -- Multi-modal UAV Dataset for Urban Scenarios [11.338399194998933]
  The scarcity of large-scale real datasets with pixel-level annotations poses a significant challenge to researchers. We propose a multimodal synthetic dataset containing both images and 3D data taken at multiple flying heights. The dataset will be made publicly available to support the development of novel computer vision methods targeting UAV applications.
  arXiv  Detail & Related papers  (2023-08-21T06:22:10Z)
• Learning Navigational Visual Representations with Semantic Map Supervision [85.91625020847358]
  We propose a navigational-specific visual representation learning method by contrasting the agent's egocentric views and semantic maps. Ego$2$-Map learning transfers the compact and rich information from a map, such as objects, structure and transition, to the agent's egocentric representations for navigation.
  arXiv  Detail & Related papers  (2023-07-23T14:01:05Z)
• A Survey on RGB-D Datasets [69.73803123972297]
  This paper reviewed and categorized image datasets that include depth information. We gathered 203 datasets that contain accessible data and grouped them into three categories: scene/objects, body, and medical.
  arXiv  Detail & Related papers  (2022-01-15T05:35:19Z)
• Occluded Video Instance Segmentation: Dataset and ICCV 2021 Challenge [133.80567761430584]
  We collect a large-scale dataset called OVIS for video instance segmentation in the occluded scenario. OVIS consists of 296k high-quality instance masks and 901 occluded scenes. All baseline methods encounter a significant performance degradation of about 80% in the heavily occluded object group.
  arXiv  Detail & Related papers  (2021-11-15T17:59:03Z)
• Salient Objects in Clutter [130.63976772770368]
  This paper identifies and addresses a serious design bias of existing salient object detection (SOD) datasets. This design bias has led to a saturation in performance for state-of-the-art SOD models when evaluated on existing datasets. We propose a new high-quality dataset and update the previous saliency benchmark.
  arXiv  Detail & Related papers  (2021-05-07T03:49:26Z)
• REGRAD: A Large-Scale Relational Grasp Dataset for Safe and Object-Specific Robotic Grasping in Clutter [52.117388513480435]
  We present a new dataset named regrad to sustain the modeling of relationships among objects and grasps. Our dataset is collected in both forms of 2D images and 3D point clouds. Users are free to import their own object models for the generation of as many data as they want.
  arXiv  Detail & Related papers  (2021-04-29T05:31:21Z)
• Exploiting Scene-specific Features for Object Goal Navigation [9.806910643086043]
  We introduce a new reduced dataset that speeds up the training of navigation models. Our proposed dataset permits the training of models that do not exploit online-built maps in reasonable times. We propose the SMTSC model, an attention-based model capable of exploiting the correlation between scenes and objects contained in them.
  arXiv  Detail & Related papers  (2020-08-21T10:16:01Z)
• The IKEA ASM Dataset: Understanding People Assembling Furniture through Actions, Objects and Pose [108.21037046507483]
  IKEA ASM is a three million frame, multi-view, furniture assembly video dataset that includes depth, atomic actions, object segmentation, and human pose. We benchmark prominent methods for video action recognition, object segmentation and human pose estimation tasks on this challenging dataset. The dataset enables the development of holistic methods, which integrate multi-modal and multi-view data to better perform on these tasks.
  arXiv  Detail & Related papers  (2020-07-01T11:34:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.