Automating Visual Recognition of Leprosy in Wild Chimpanzees
- URL: http://arxiv.org/abs/2607.17395v1
- Date: Sun, 19 Jul 2026 20:00:40 GMT
- Title: Automating Visual Recognition of Leprosy in Wild Chimpanzees
- Abstract summary: We present the first deep learning pipeline for wildlife leprosy detection.<n>We contribute the PanLep300 dataset of 125,670 annotated bounding-box crops across 953 tracks.<n>We find that simple aggregation of crop-level predictions consistently matches or outperforms both learned temporal models and end-to-end video architectures.
- Score: 5.127434779390129
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Leprosy (Mycobacterium leprae) has been confirmed in wild western chimpanzees (Pan troglodytes verus) in West Africa, presenting as clear and progressive visual symptoms. Manual review of camera-trap footage at landscape scale is infeasible, motivating the need for automated screening. We present the first deep learning pipeline for wildlife leprosy detection and contribute the PanLep300 dataset of 125,670 annotated bounding-box crops across 953 tracks from 303 camera-trap videos with ecologically-motivated splits that withhold whole individuals and camera installations. We benchmark spatial (2D), temporally aggregated (2.5D), and video-based (3D) classification approaches to investigate which approach is best suited to automated leprosy detection in wild apes. We find that simple aggregation of crop-level predictions consistently matches or outperforms both learned temporal models and end-to-end video architectures -- consistent with leprosy's static cutaneous presentation. We further find that performance is suppressed when tracklets contain frames of partially visible individuals -- as commonly occurs at the start and end of a track -- and demonstrate that this can be addressed through targeted construction and aggregation strategies.
Related papers
- A non-invasive video-based method for individual identification of wildlife using gait dynamics [21.468912995256698]
This paper presents a fully automated video-based pipeline for wildlife gait analysis and individual identification.<n>The proposed pipeline uses Segment Anything Model 3 (SAM3) to generate high-quality RGB and binary silhouette masks.<n>Cosine is then used to compare gait signatures, enabling similarity-based clustering of individuals without reliance on physical or invasive markings.
arXiv Detail & Related papers (2026-07-05T21:47:21Z) - Cross-Modal Corroboration for Annotation-Free Wildlife Monitoring [0.29891208411734166]
Scaling wildlife monitoring for real-world conservation deployments requires automated analysis of smart sensors that operate under severe annotation scarcity.<n>We propose leveraging expert knowledge of species activity patterns as an annotation-free validation signal for multimodal monitoring pipelines.<n>We validate the pipeline on a breeding herd of Milu deer and demonstrate that both modalities independently recover activity patterns consistent with known deer behavioral ecology.
arXiv Detail & Related papers (2026-06-19T17:17:31Z) - Self-supervised Learning on Camera Trap Footage Yields a Strong Universal Face Embedder [48.03572115000886]
This study introduces a fully self-supervised approach to learning robust chimpanzee face embeddings from unlabeled camera-trap footage.<n>We train Vision Transformers on automatically mined face crops, eliminating the need for identity labels.<n>This work underscores the potential of self-supervised learning in biodiversity monitoring and paves the way for scalable, non-invasive population studies.
arXiv Detail & Related papers (2025-07-14T17:59:59Z) - The PanAf-FGBG Dataset: Understanding the Impact of Backgrounds in Wildlife Behaviour Recognition [9.865022241248116]
We present the PanAf-FGBG dataset, featuring 20 hours of wild chimpanzee behaviours, recorded at over 350 individual camera locations.<n>Uniquely, it pairs every video with a chimpanzee (referred to as a foreground video) with a corresponding background video (with no chimpanzee) from the same camera location.<n>This setup enables, for the first time, direct evaluation of in-distribution and out-of-distribution conditions, and for the impact of backgrounds on behaviour recognition models to be quantified.
arXiv Detail & Related papers (2025-02-28T16:18:57Z) - Multimodal Foundation Models for Zero-shot Animal Species Recognition in
Camera Trap Images [57.96659470133514]
Motion-activated camera traps constitute an efficient tool for tracking and monitoring wildlife populations across the globe.
Supervised learning techniques have been successfully deployed to analyze such imagery, however training such techniques requires annotations from experts.
Reducing the reliance on costly labelled data has immense potential in developing large-scale wildlife tracking solutions with markedly less human labor.
arXiv Detail & Related papers (2023-11-02T08:32:00Z) - SVFormer: Semi-supervised Video Transformer for Action Recognition [88.52042032347173]
We introduce SVFormer, which adopts a steady pseudo-labeling framework to cope with unlabeled video samples.
In addition, we propose a temporal warping to cover the complex temporal variation in videos.
In particular, SVFormer outperforms the state-of-the-art by 31.5% with fewer training epochs under the 1% labeling rate of Kinetics-400.
arXiv Detail & Related papers (2022-11-23T18:58:42Z) - TempNet: Temporal Attention Towards the Detection of Animal Behaviour in
Videos [63.85815474157357]
We propose an efficient computer vision- and deep learning-based method for the detection of biological behaviours in videos.
TempNet uses an encoder bridge and residual blocks to maintain model performance with a two-staged, spatial, then temporal, encoder.
We demonstrate its application to the detection of sablefish (Anoplopoma fimbria) startle events.
arXiv Detail & Related papers (2022-11-17T23:55:12Z) - APT-36K: A Large-scale Benchmark for Animal Pose Estimation and Tracking [77.87449881852062]
APT-36K is the first large-scale benchmark for animal pose estimation and tracking.
It consists of 2,400 video clips collected and filtered from 30 animal species with 15 frames for each video, resulting in 36,000 frames in total.
We benchmark several representative models on the following three tracks: (1) supervised animal pose estimation on a single frame under intra- and inter-domain transfer learning settings, (2) inter-species domain generalization test for unseen animals, and (3) animal pose estimation with animal tracking.
arXiv Detail & Related papers (2022-06-12T07:18:36Z) - AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs
in the Wild [51.35013619649463]
We present an extensive dataset of free-running cheetahs in the wild, called AcinoSet.
The dataset contains 119,490 frames of multi-view synchronized high-speed video footage, camera calibration files and 7,588 human-annotated frames.
The resulting 3D trajectories, human-checked 3D ground truth, and an interactive tool to inspect the data is also provided.
arXiv Detail & Related papers (2021-03-24T15:54:11Z) - An explainable deep vision system for animal classification and
detection in trail-camera images with automatic post-deployment retraining [0.0]
This paper introduces an automated vision system for animal detection in trail-camera images taken from a field under the administration of the Texas Parks and Wildlife Department.
We implement a two-stage deep convolutional neural network pipeline to find animal-containing images in the first stage and then process these images to detect birds in the second stage.
The animal classification system classifies animal images with overall 93% sensitivity and 96% specificity. The bird detection system achieves better than 93% sensitivity, 92% specificity, and 68% average Intersection-over-Union rate.
arXiv Detail & Related papers (2020-10-22T06:29:55Z) - Automatic Detection and Recognition of Individuals in Patterned Species [4.163860911052052]
We develop a framework for automatic detection and recognition of individuals in different patterned species.
We use the recently proposed Faster-RCNN object detection framework to efficiently detect animals in images.
We evaluate our recognition system on zebra and jaguar images to show generalization to other patterned species.
arXiv Detail & Related papers (2020-05-06T15:29:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.