CHIRP dataset: towards long-term, individual-level, behavioral monitoring of bird populations in the wild

• URL: http://arxiv.org/abs/2603.25524v1
• Date: Thu, 26 Mar 2026 14:57:31 GMT
• Title: CHIRP dataset: towards long-term, individual-level, behavioral monitoring of bird populations in the wild
• Abstract summary: Long-term behavioral monitoring of individual animals is crucial for studying behavioral changes that occur over different time scales.<n>Computer vision methods have proven to benefit biodiversity monitoring, but automated behavior monitoring in wild populations remains challenging.<n>Here, we introduce such a dataset (CHIRP) with a new method (CORVID) for individual re-identification of wild birds.
• Score: 2.172490512050822
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Long-term behavioral monitoring of individual animals is crucial for studying behavioral changes that occur over different time scales, especially for conservation and evolutionary biology. Computer vision methods have proven to benefit biodiversity monitoring, but automated behavior monitoring in wild populations remains challenging. This stems from the lack of datasets that cover a range of computer vision tasks necessary to extract biologically meaningful measurements of individual animals. Here, we introduce such a dataset (CHIRP) with a new method (CORVID) for individual re-identification of wild birds. The CHIRP (Combining beHaviour, Individual Re-identification and Postures) dataset is curated from a long-term population of wild Siberian jays studied in Swedish Lapland, supporting re-identification (re-id), action recognition, 2D keypoint estimation, object detection, and instance segmentation. In addition to traditional task-specific benchmarking, we introduce application-specific benchmarking with biologically relevant metrics (feeding rates, co-occurrence rates) to evaluate the performance of models in real-world use cases. Finally, we present CORVID (COlouR-based Video re-ID), a novel pipeline for individual identification of birds based on the segmentation and classification of colored leg rings, a widespread approach for visual identification of individual birds. CORVID offers a probability-based id tracking method by matching the detected combination of color rings with a database. We use application-specific benchmarking to show that CORVID outperforms state-of-the-art re-id methods. We hope this work offers the community a blueprint for curating real-world datasets from ethically approved biological studies to bridge the gap between computer vision research and biological applications.

Related papers

• What Does Animal Re-Identification Learn? Linear Biological Concepts and Their Origins in Visual Representations [52.11506532642883]
  We show that sex and age emerge as linear directions that generalize to held-out individuals.<n>We also show that sex direction is causally used by the model, flipping a significant fraction of predictions to the opposite sex.
  arXiv  Detail & Related papers  (2026-09-05T10:46:27Z)
• A non-invasive video-based method for individual identification of wildlife using gait dynamics [21.468912995256698]
  This paper presents a fully automated video-based pipeline for wildlife gait analysis and individual identification.<n>The proposed pipeline uses Segment Anything Model 3 (SAM3) to generate high-quality RGB and binary silhouette masks.<n>Cosine is then used to compare gait signatures, enabling similarity-based clustering of individuals without reliance on physical or invasive markings.
  arXiv  Detail & Related papers  (2026-07-05T21:47:21Z)
• Autonomous UAV Navigation for Individual Wildlife Re-Identification [0.350327094468706]
  We propose an autonomous drone navigation system that actively optimize image capture for downstream re-ID.<n>The system combines YOLOv11 object detection with a DINOv2-based pose to guide real-time flight decisions.<n>We show the approach generalizes to other species with diagnostic surface patterns, including giraffes, tigers, and elephants.
  arXiv  Detail & Related papers  (2026-06-30T14:56:04Z)
• Exploring Clustering Capability of Inpainting Model Embeddings for Pattern-based Individual Identification [2.227417514684251]
  We focus on techniques that will make machine learning models more responsive to skin pattern structure.<n>We propose a comparative analysis among four models as an encoder backbone for the individual identification task.<n>We focus on the case study of zebrafish, which is a widely recognized biological model organism.
  arXiv  Detail & Related papers  (2026-05-06T13:33:14Z)
• Re-Identifying Kākā with AI-Automated Video Key Frame Extraction [0.0]
  This study presents a unique pipeline for extracting high-quality key frames from videos of k=ak=a (Nestor meridionalis)<n>Using video recordings at a custom-built feeder, we extract key frames and evaluate the re-identification performance of our pipeline.<n>Results indicate that our proposed key frame selection methods yield image collections which achieve high accuracy in k=ak=a re-identification.
  arXiv  Detail & Related papers  (2025-10-09T19:46:46Z)
• kabr-tools: Automated Framework for Multi-Species Behavioral Monitoring [4.303185550812535]
  We present kabr-tools, an open-source package for automated multi-species behavioral monitoring.<n>This framework integrates drone-based video with machine learning systems to extract behavioral, social, and spatial metrics from wildlife footage.<n>Compared to ground-based methods, drone-based observations significantly improved behavioral granularity, reducing visibility loss by 15%.
  arXiv  Detail & Related papers  (2025-10-02T14:03:55Z)
• BioCLIP 2: Emergent Properties from Scaling Hierarchical Contrastive Learning [60.80381372245902]
  We find emergent behaviors in biological vision models via large-scale contrastive vision-language training.<n>We train BioCLIP 2 on TreeOfLife-200M to distinguish different species.<n>We identify emergent properties in the learned embedding space of BioCLIP 2.
  arXiv  Detail & Related papers  (2025-05-29T17:48:20Z)
• Consistent multi-animal pose estimation in cattle using dynamic Kalman filter based tracking [0.0]
  KeySORT is an adaptive Kalman filter to construct tracklets in a bounding-box free manner, significantly improving the temporal consistency of detected keypoints.<n>Our test results indicate our algorithm is able to detect up to 80% of the ground truth keypoints with high accuracy.
  arXiv  Detail & Related papers  (2025-03-13T15:15:54Z)
• Open-Set Recognition of Novel Species in Biodiversity Monitoring [21.00825480154685]
  We introduce Open-Insects, a fine-grained image recognition benchmark dataset for open-set recognition and out-of-distribution detection.<n>We evaluate a variety of open-set recognition algorithms, including post-hoc methods, training-time regularization, and training with auxiliary data.
  arXiv  Detail & Related papers  (2025-03-03T16:04:46Z)
• Meta-Learners for Partially-Identified Treatment Effects Across Multiple Environments [67.80453452949303]
  Estimating the conditional average treatment effect (CATE) from observational data is relevant for many applications such as personalized medicine. Here, we focus on the widespread setting where the observational data come from multiple environments. We propose different model-agnostic learners (so-called meta-learners) to estimate the bounds that can be used in combination with arbitrary machine learning models.
  arXiv  Detail & Related papers  (2024-06-04T16:31:43Z)
• SatBird: Bird Species Distribution Modeling with Remote Sensing and Citizen Science Data [68.2366021016172]
  We present SatBird, a satellite dataset of locations in the USA with labels derived from presence-absence observation data from the citizen science database eBird. We also provide a dataset in Kenya representing low-data regimes. We benchmark a set of baselines on our dataset, including SOTA models for remote sensing tasks.
  arXiv  Detail & Related papers  (2023-11-02T02:00:27Z)
• Persistent Animal Identification Leveraging Non-Visual Markers [71.14999745312626]
  We aim to locate and provide a unique identifier for each mouse in a cluttered home-cage environment through time. This is a very challenging problem due to (i) the lack of distinguishing visual features for each mouse, and (ii) the close confines of the scene with constant occlusion. Our approach achieves 77% accuracy on this animal identification problem, and is able to reject spurious detections when the animals are hidden.
  arXiv  Detail & Related papers  (2021-12-13T17:11:32Z)
• Automatic image-based identification and biomass estimation of invertebrates [70.08255822611812]
  Time-consuming sorting and identification of taxa pose strong limitations on how many insect samples can be processed. We propose to replace the standard manual approach of human expert-based sorting and identification with an automatic image-based technology. We use state-of-the-art Resnet-50 and InceptionV3 CNNs for the classification task.
  arXiv  Detail & Related papers  (2020-02-05T21:38:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.