Low-cost Robust Night-time Aerial Material Segmentation through Hyperspectral Data and Sparse Spatio-Temporal Learning

• URL: http://arxiv.org/abs/2410.15208v1
• Date: Sat, 19 Oct 2024 20:48:41 GMT
• Title: Low-cost Robust Night-time Aerial Material Segmentation through Hyperspectral Data and Sparse Spatio-Temporal Learning
• Abstract summary: Hyperspectral data from specialized cameras can be very useful in addition to RGB images. incorporating such data into a learning-based segmentation framework is challenging due to the numerous data channels involved. We propose an innovative Siamese framework that uses time series-based compression to effectively and scalably integrate the additional spectral data into the segmentation task.
• Score: 3.0077933778535706
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Material segmentation is a complex task, particularly when dealing with aerial data in poor lighting and atmospheric conditions. To address this, hyperspectral data from specialized cameras can be very useful in addition to RGB images. However, due to hardware constraints, high spectral data often come with lower spatial resolution. Additionally, incorporating such data into a learning-based segmentation framework is challenging due to the numerous data channels involved. To overcome these difficulties, we propose an innovative Siamese framework that uses time series-based compression to effectively and scalably integrate the additional spectral data into the segmentation task. We demonstrate our model's effectiveness through competitive benchmarks on aerial datasets in various environmental conditions.

Related papers

• SkyEV: RGB-Event UAV detection and tracking dataset and baseline [7.035143064175411]
  We introduce SkyEV, an open-source dataset featuring highly synchronized RGB and event-based data.<n>SkyEV distinguishes itself by capturing complex real-world conditions, including camera motion and varied optical setups.<n>We provide a unified data loader and establish an experimental baseline, demonstrating the dataset's efficacy in detecting challenging, small-scale targets.
  arXiv  Detail & Related papers  (2026-07-21T06:12:06Z)
• FEMOT: Multi-Object Tracking using Frame and Event Cameras [57.75021868843091]
  Bio-inspired event cameras offer high temporal resolution and high dynamic range, providing complementary cues under extreme scenarios.<n>FEMOT is a large-scale RGB-event multi-object tracking dataset that covers diverse real-world scenarios and 14 challenging attributes.<n>FEMOTR is a multimodal tracking framework that decouples RGB and event features and fuses them in the frequency domain.
  arXiv  Detail & Related papers  (2026-06-12T04:17:41Z)
• The Spectrascapes Dataset: Street-view imagery beyond the visible captured using a mobile platform [0.89663346270118]
  This dataset consists of 17,718 street level multi-spectral images captured with RGB, infrared, and Thermal imaging sensors on bikes.<n>To the best of our knowledge, Spectrascapes is the first open-access dataset of its kind.
  arXiv  Detail & Related papers  (2026-04-14T21:41:23Z)
• Decoupling Amplitude and Phase Attention in Frequency Domain for RGB-Event based Visual Object Tracking [51.31378940976401]
  Existing RGB-Event tracking approaches fail to fully exploit the unique advantages of event cameras.<n>We propose a novel tracking framework that performs early fusion in the frequency domain, enabling effective aggregation of high-frequency information from the event modality.<n>Experiments on three widely used RGB-Event tracking benchmark datasets, including FE108, FELT, and COESOT, demonstrate the high performance and efficiency of our method.
  arXiv  Detail & Related papers  (2026-01-03T01:10:17Z)
• A New Dataset and Performance Benchmark for Real-time Spacecraft Segmentation in Onboard Flight Computers [2.8519379677270997]
  We present a new dataset of nearly 64k annotated spacecraft images that was created using real spacecraft models.<n>To mimic camera distortions and noise in real-world image acquisition, we also added different types of noise and distortion to the images.<n>The resulting models, when tested under well-defined hardware and inference time constraints, achieved a Dice score of 0.92, Hausdorff distance of 0.69, and an inference time of about 0.5 second.
  arXiv  Detail & Related papers  (2025-07-14T20:02:40Z)
• Metadata, Wavelet, and Time Aware Diffusion Models for Satellite Image Super Resolution [4.307648859471193]
  MWT-Diff is an innovative framework for satellite image super-resolution (SR)<n>At the core of the framework is a novel metadata-, wavelet-, and time-aware encoder (MWT-Encoder)<n>The embedded feature representations steer the hierarchical diffusion dynamics, through which the model progressively reconstructs high-resolution satellite imagery from low-resolution inputs.
  arXiv  Detail & Related papers  (2025-06-30T07:19:50Z)
• Rethinking High-speed Image Reconstruction Framework with Spike Camera [48.627095354244204]
  Spike cameras generate continuous spike streams to capture high-speed scenes with lower bandwidth and higher dynamic range than traditional RGB cameras. We introduce a novel spike-to-image reconstruction framework SpikeCLIP that goes beyond traditional training paradigms. Our experiments on real-world low-light datasets demonstrate that SpikeCLIP significantly enhances texture details and the luminance balance of recovered images.
  arXiv  Detail & Related papers  (2025-01-08T13:00:17Z)
• Exploring Fully Convolutional Networks for the Segmentation of Hyperspectral Imaging Applied to Advanced Driver Assistance Systems [1.8874331450711404]
  We explore the use of hyperspectral imaging (HSI) in Advanced Driver Assistance Systems (ADAS) This paper describes some experimental results of the application of fully convolutional networks (FCN) to the image segmentation of HSI for ADAS applications. We use the HSI-Drive v1.1 dataset, which provides a set of labelled images recorded in real driving conditions with a small-size snapshot NIR-HSI camera.
  arXiv  Detail & Related papers  (2024-12-05T08:58:25Z)
• Enabling High Data Throughput Reinforcement Learning on GPUs: A Domain Agnostic Framework for Data-Driven Scientific Research [90.91438597133211]
  We introduce WarpSci, a framework designed to overcome crucial system bottlenecks in the application of reinforcement learning. We eliminate the need for data transfer between the CPU and GPU, enabling the concurrent execution of thousands of simulations.
  arXiv  Detail & Related papers  (2024-08-01T21:38:09Z)
• Hyperspectral Dataset and Deep Learning methods for Waste from Electric and Electronic Equipment Identification (WEEE) [0.0]
  We evaluate the performance of diverse deep learning architectures for hyperspectral image segmentation. Results show that incorporating spatial information alongside spectral data leads to improved segmentation results. We contribute to the field by cleaning and publicly releasing the Tecnalia WEEE Hyperspectral dataset.
  arXiv  Detail & Related papers  (2024-07-05T13:45:11Z)
• Datacube segmentation via Deep Spectral Clustering [76.48544221010424]
  Extended Vision techniques often pose a challenge in their interpretation. The huge dimensionality of data cube spectra poses a complex task in its statistical interpretation. In this paper, we explore the possibility of applying unsupervised clustering methods in encoded space. A statistical dimensional reduction is performed by an ad hoc trained (Variational) AutoEncoder, while the clustering process is performed by a (learnable) iterative K-Means clustering algorithm.
  arXiv  Detail & Related papers  (2024-01-31T09:31:28Z)
• Anomaly Detection in Satellite Videos using Diffusion Models [5.378437695174892]
  Real-time detection of extreme events using satellite data has become crucial for disaster management. We present a diffusion model which does not need any motion component to capture the fast-moving anomalies.
  arXiv  Detail & Related papers  (2023-05-25T19:17:39Z)
• Imbalanced Aircraft Data Anomaly Detection [103.01418862972564]
  Anomaly detection in temporal data from sensors under aviation scenarios is a practical but challenging task. We propose a Graphical Temporal Data Analysis framework. It consists three modules, named Series-to-Image (S2I), Cluster-based Resampling Approach using Euclidean Distance (CRD) and Variance-Based Loss (VBL)
  arXiv  Detail & Related papers  (2023-05-17T09:37:07Z)
• Multimodal Dataset from Harsh Sub-Terranean Environment with Aerosol Particles for Frontier Exploration [55.41644538483948]
  This paper introduces a multimodal dataset from the harsh and unstructured underground environment with aerosol particles. It contains synchronized raw data measurements from all onboard sensors in Robot Operating System (ROS) format. The focus of this paper is not only to capture both temporal and spatial data diversities but also to present the impact of harsh conditions on captured data.
  arXiv  Detail & Related papers  (2023-04-27T20:21:18Z)
• DOORS: Dataset fOr bOuldeRs Segmentation. Statistical properties and Blender setup [0.0]
  The capability to detect boulders on the surface of small bodies is beneficial for vision-based applications such as hazard detection during critical operations and navigation. This work provides a statistical characterization and setup used for the generation of two datasets about boulders on small bodies that are made publicly available.
  arXiv  Detail & Related papers  (2022-10-28T16:39:06Z)
• Satellite Image Time Series Analysis for Big Earth Observation Data [50.591267188664666]
  This paper describes sits, an open-source R package for satellite image time series analysis using machine learning. We show that this approach produces high accuracy for land use and land cover maps through a case study in the Cerrado biome.
  arXiv  Detail & Related papers  (2022-04-24T15:23:25Z)
• Coherent Loss: A Generic Framework for Stable Video Segmentation [103.78087255807482]
  We investigate how a jittering artifact degrades the visual quality of video segmentation results. We propose a Coherent Loss with a generic framework to enhance the performance of a neural network against jittering artifacts.
  arXiv  Detail & Related papers  (2020-10-25T10:48:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.