Cross-Modal Corroboration for Annotation-Free Wildlife Monitoring

• URL: http://arxiv.org/abs/2606.21613v1
• Date: Fri, 19 Jun 2026 17:17:31 GMT
• Title: Cross-Modal Corroboration for Annotation-Free Wildlife Monitoring
• Abstract summary: Scaling wildlife monitoring for real-world conservation deployments requires automated analysis of smart sensors that operate under severe annotation scarcity.<n>We propose leveraging expert knowledge of species activity patterns as an annotation-free validation signal for multimodal monitoring pipelines.<n>We validate the pipeline on a breeding herd of Milu deer and demonstrate that both modalities independently recover activity patterns consistent with known deer behavioral ecology.
• Score: 0.29891208411734166
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Scaling wildlife monitoring for real-world conservation deployments requires automated analysis of smart sensors that operate under severe annotation scarcity. We propose leveraging expert knowledge of species activity patterns as an annotation-free validation signal for multimodal monitoring pipelines. We operationalize agreement as the alignment of independently derived hourly activity curves both with each other and with published behavioral priors-a three-way convergence that rules out shared-data confounds and dataset-internal correlation as alternative explanations. Our vision pipeline combines zero-shot species detection via BioCLIP 2, sliced inference to handle deployment-constrained camera positioning, and geometry-based geographic localization from camera trap imagery. Our acoustic pipeline detects species vocalizations via a fine-tuned classifier. We validate the pipeline on a breeding herd of Milu deer and demonstrate that both modalities independently recover activity patterns consistent with known deer behavioral ecology with minimal manual annotation. The framework applies to species detectable in both visual and acoustic modalities for which behavioral priors are documented in the literature, suggesting a practical path toward self-validating wildlife-monitoring pipelines at conservation scale.

Related papers

• Promptable Animal Pose Tracking Across Species [6.856674886457795]
  Animal pose estimation and tracking is important for wildlife monitoring and conservation research.<n>We show that vision foundation models trained on large datasets can be used effectively to track animal pose with limited labelled data.<n>We propose two models, one unsupervised and the other supervised, to track user-selected keypoints in videos.
  arXiv  Detail & Related papers  (2026-08-05T16:04:20Z)
• A non-invasive video-based method for individual identification of wildlife using gait dynamics [21.468912995256698]
  This paper presents a fully automated video-based pipeline for wildlife gait analysis and individual identification.<n>The proposed pipeline uses Segment Anything Model 3 (SAM3) to generate high-quality RGB and binary silhouette masks.<n>Cosine is then used to compare gait signatures, enabling similarity-based clustering of individuals without reliance on physical or invasive markings.
  arXiv  Detail & Related papers  (2026-07-05T21:47:21Z)
• Re-Identifying Kākā with AI-Automated Video Key Frame Extraction [0.0]
  This study presents a unique pipeline for extracting high-quality key frames from videos of k=ak=a (Nestor meridionalis)<n>Using video recordings at a custom-built feeder, we extract key frames and evaluate the re-identification performance of our pipeline.<n>Results indicate that our proposed key frame selection methods yield image collections which achieve high accuracy in k=ak=a re-identification.
  arXiv  Detail & Related papers  (2025-10-09T19:46:46Z)
• kabr-tools: Automated Framework for Multi-Species Behavioral Monitoring [4.303185550812535]
  We present kabr-tools, an open-source package for automated multi-species behavioral monitoring.<n>This framework integrates drone-based video with machine learning systems to extract behavioral, social, and spatial metrics from wildlife footage.<n>Compared to ground-based methods, drone-based observations significantly improved behavioral granularity, reducing visibility loss by 15%.
  arXiv  Detail & Related papers  (2025-10-02T14:03:55Z)
• A Computer Vision Pipeline for Individual-Level Behavior Analysis: Benchmarking on the Edinburgh Pig Dataset [0.46297934208241753]
  Animal behavior analysis plays a crucial role in understanding animal welfare, health status, and productivity in agricultural settings.<n>We present a modular pipeline that leverages open-sourced state-of-the-art computer vision techniques to automate animal behavior analysis in a group housing environment.<n>Our approach combines state-of-the-art models for zero-shot object detection, motion-aware tracking and segmentation, and advanced feature extraction using vision transformers for robust behavior recognition.
  arXiv  Detail & Related papers  (2025-09-15T15:31:12Z)
• Downstream-Pretext Domain Knowledge Traceback for Active Learning [138.02530777915362]
  We propose a downstream-pretext domain knowledge traceback (DOKT) method that traces the data interactions of downstream knowledge and pre-training guidance. DOKT consists of a traceback diversity indicator and a domain-based uncertainty estimator. Experiments conducted on ten datasets show that our model outperforms other state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-07-20T01:34:13Z)
• Weakly supervised marine animal detection from remote sensing images using vector-quantized variational autoencoder [4.812718493682454]
  This paper studies a reconstruction-based approach for weakly-supervised animal detection from aerial images in marine environments. An anomaly detection framework computes metrics directly on the input space, enhancing interpretability and anomaly localization. Our framework offers improved interpretability and localization of anomalies, providing valuable insights for monitoring marine ecosystems.
  arXiv  Detail & Related papers  (2023-07-13T12:26:27Z)
• Weakly-Supervised Spatio-Temporal Anomaly Detection in Surveillance Video [128.41392860714635]
  We introduce Weakly-Supervised Snoma-Temporally Detection (WSSTAD) in surveillance video. WSSTAD aims to localize a-temporal tube (i.e. sequence of bounding boxes at consecutive times) that encloses abnormal event. We propose a dual-branch network which takes as input proposals with multi-granularities in both spatial-temporal domains.
  arXiv  Detail & Related papers  (2021-08-09T06:11:14Z)
• WSSOD: A New Pipeline for Weakly- and Semi-Supervised Object Detection [75.80075054706079]
  We propose a weakly- and semi-supervised object detection framework (WSSOD) An agent detector is first trained on a joint dataset and then used to predict pseudo bounding boxes on weakly-annotated images. The proposed framework demonstrates remarkable performance on PASCAL-VOC and MSCOCO benchmark, achieving a high performance comparable to those obtained in fully-supervised settings.
  arXiv  Detail & Related papers  (2021-05-21T11:58:50Z)
• Unsupervised Sound Localization via Iterative Contrastive Learning [106.56167882750792]
  We propose an iterative contrastive learning framework that requires no data annotations. We then use the pseudo-labels to learn the correlation between the visual and audio signals sampled from the same video. Our iterative strategy gradually encourages the localization of the sounding objects and reduces the correlation between the non-sounding regions and the reference audio.
  arXiv  Detail & Related papers  (2021-04-01T07:48:29Z)
• Intersection Regularization for Extracting Semantic Attributes [72.53481390411173]
  We consider the problem of supervised classification, such that the features that the network extracts match an unseen set of semantic attributes. For example, when learning to classify images of birds into species, we would like to observe the emergence of features that zoologists use to classify birds. We propose training a neural network with discrete top-level activations, which is followed by a multi-layered perceptron (MLP) and a parallel decision tree.
  arXiv  Detail & Related papers  (2021-03-22T14:32:44Z)
• TraND: Transferable Neighborhood Discovery for Unsupervised Cross-domain Gait Recognition [77.77786072373942]
  This paper proposes a Transferable Neighborhood Discovery (TraND) framework to bridge the domain gap for unsupervised cross-domain gait recognition. We design an end-to-end trainable approach to automatically discover the confident neighborhoods of unlabeled samples in the latent space. Our method achieves state-of-the-art results on two public datasets, i.e., CASIA-B and OU-LP.
  arXiv  Detail & Related papers  (2021-02-09T03:07:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.