Tracking and triangulating firefly flashes in field recordings

• URL: http://arxiv.org/abs/2410.19932v1
• Date: Fri, 25 Oct 2024 19:07:55 GMT
• Title: Tracking and triangulating firefly flashes in field recordings
• Authors: Raphael Sarfati,
• Abstract summary: I provide a training dataset and trained neural networks for reliable flash classification. This robust tracking enables a new calibration-free method for the 3D reconstruction of flash occurrences from stereoscopic 360-degree videos.
• Score: 0.0
• License:
• Abstract: Identifying firefly flashes from other bright features in nature images is complicated. I provide a training dataset and trained neural networks for reliable flash classification. The training set consists of thousands of cropped images (patches) extracted by manual labeling from video recordings of fireflies in their natural habitat. The trained network appears as considerably more reliable to differentiate flashes from other sources of light compared to traditional methods relying solely on intensity thresholding. This robust tracking enables a new calibration-free method for the 3D reconstruction of flash occurrences from stereoscopic 360-degree videos, which I also present here.

Related papers

• Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats [13.27784783829039]
  We introduce a simple yet effective approach for separating transmitted and reflected light. Our method, Flash-Splat, accurately reconstructs both transmitted and reflected scenes in 3D.
  arXiv  Detail & Related papers  (2024-10-03T17:59:59Z)
• BVI-RLV: A Fully Registered Dataset and Benchmarks for Low-Light Video Enhancement [56.97766265018334]
  This paper introduces a low-light video dataset, consisting of 40 scenes with various motion scenarios under two distinct low-lighting conditions. We provide fully registered ground truth data captured in normal light using a programmable motorized dolly and refine it via an image-based approach for pixel-wise frame alignment across different light levels. Our experimental results demonstrate the significance of fully registered video pairs for low-light video enhancement (LLVE) and the comprehensive evaluation shows that the models trained with our dataset outperform those trained with the existing datasets.
  arXiv  Detail & Related papers  (2024-07-03T22:41:49Z)
• Multimodal Foundation Models for Zero-shot Animal Species Recognition in Camera Trap Images [57.96659470133514]
  Motion-activated camera traps constitute an efficient tool for tracking and monitoring wildlife populations across the globe. Supervised learning techniques have been successfully deployed to analyze such imagery, however training such techniques requires annotations from experts. Reducing the reliance on costly labelled data has immense potential in developing large-scale wildlife tracking solutions with markedly less human labor.
  arXiv  Detail & Related papers  (2023-11-02T08:32:00Z)
• Improving Lens Flare Removal with General Purpose Pipeline and Multiple Light Sources Recovery [69.71080926778413]
  flare artifacts can affect image visual quality and downstream computer vision tasks. Current methods do not consider automatic exposure and tone mapping in image signal processing pipeline. We propose a solution to improve the performance of lens flare removal by revisiting the ISP and design a more reliable light sources recovery strategy.
  arXiv  Detail & Related papers  (2023-08-31T04:58:17Z)
• Robust Reflection Removal with Flash-only Cues in the Wild [88.13531903652526]
  We propose a reflection-free cue for robust reflection removal from a pair of flash and ambient (no-flash) images. Our model outperforms state-of-the-art reflection removal approaches by more than 5.23dB in PSNR. We extend our approach to handheld photography to address the misalignment between the flash and no-flash pair.
  arXiv  Detail & Related papers  (2022-11-05T14:09:10Z)
• Seeing Far in the Dark with Patterned Flash [5.540878289831889]
  We propose a new flash technique, named patterned flash'', for flash imaging at a long distance. Patterned flash concentrates optical power into a dot array. We develop a joint image reconstruction and depth estimation algorithm with a convolutional neural network.
  arXiv  Detail & Related papers  (2022-07-25T23:16:50Z)
• Relightable 3D Head Portraits from a Smartphone Video [15.639140551193073]
  We present a system for creating a relightable 3D portrait of a human head. Our neural pipeline operates on a sequence of frames captured by a smartphone camera with the flash blinking. A deep rendering network is trained to regress dense albedo, normals, and environmental lighting maps for arbitrary new viewpoints.
  arXiv  Detail & Related papers  (2020-12-17T22:49:02Z)
• Deep Denoising of Flash and No-Flash Pairs for Photography in Low-Light Environments [51.74566709730618]
  We introduce a neural network-based method to denoise pairs of images taken in quick succession, with and without a flash, in low-light environments. Our goal is to produce a high-quality rendering of the scene that preserves the color and mood from the ambient illumination of the noisy no-flash image.
  arXiv  Detail & Related papers  (2020-12-09T15:41:16Z)
• Data-driven Meta-set Based Fine-Grained Visual Classification [61.083706396575295]
  We propose a data-driven meta-set based approach to deal with noisy web images for fine-grained recognition. Specifically, guided by a small amount of clean meta-set, we train a selection net in a meta-learning manner to distinguish in- and out-of-distribution noisy images.
  arXiv  Detail & Related papers  (2020-08-06T03:04:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.