Livestock Monitoring with Transformer

• URL: http://arxiv.org/abs/2111.00801v2
• Date: Tue, 2 Nov 2021 15:15:28 GMT
• Title: Livestock Monitoring with Transformer
• Authors: Bhavesh Tangirala, Ishan Bhandari, Daniel Laszlo, Deepak K. Gupta, Rajat M. Thomas, Devanshu Arya
• Abstract summary: We develop an end-to-end behaviour monitoring system for group-housed pigs to perform simultaneous instance level segmentation, tracking, action recognition and re-identification tasks. We present starformer, the first end-to-end multiple-object livestock monitoring framework that learns instance-level embeddings for grouped pigs through the use of transformer architecture.
• Score: 4.298326853567677
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Tracking the behaviour of livestock enables early detection and thus prevention of contagious diseases in modern animal farms. Apart from economic gains, this would reduce the amount of antibiotics used in livestock farming which otherwise enters the human diet exasperating the epidemic of antibiotic resistance - a leading cause of death. We could use standard video cameras, available in most modern farms, to monitor livestock. However, most computer vision algorithms perform poorly on this task, primarily because, (i) animals bred in farms look identical, lacking any obvious spatial signature, (ii) none of the existing trackers are robust for long duration, and (iii) real-world conditions such as changing illumination, frequent occlusion, varying camera angles, and sizes of the animals make it hard for models to generalize. Given these challenges, we develop an end-to-end behaviour monitoring system for group-housed pigs to perform simultaneous instance level segmentation, tracking, action recognition and re-identification (STAR) tasks. We present starformer, the first end-to-end multiple-object livestock monitoring framework that learns instance-level embeddings for grouped pigs through the use of transformer architecture. For benchmarking, we present Pigtrace, a carefully curated dataset comprising video sequences with instance level bounding box, segmentation, tracking and activity classification of pigs in real indoor farming environment. Using simultaneous optimization on STAR tasks we show that starformer outperforms popular baseline models trained for individual tasks.

Related papers

• BuckTales : A multi-UAV dataset for multi-object tracking and re-identification of wild antelopes [0.6267336085190178]
  BuckTales is the first large-scale UAV dataset designed to solve multi-object tracking and re-identification problem in wild animals. The MOT dataset includes over 1.2 million annotations including 680 tracks across 12 high-resolution (5.4K) videos. The Re-ID dataset includes 730 individuals captured with two UAVs simultaneously.
  arXiv  Detail & Related papers  (2024-11-11T11:55:14Z)
• AnimalFormer: Multimodal Vision Framework for Behavior-based Precision Livestock Farming [0.0]
  We introduce a multimodal vision framework for precision livestock farming. We harness the power of GroundingDINO, HQSAM, and ViTPose models. This suite enables comprehensive behavioral analytics from video data without invasive animal tagging.
  arXiv  Detail & Related papers  (2024-06-14T04:42:44Z)
• Computer Vision for Primate Behavior Analysis in the Wild [61.08941894580172]
  Video-based behavioral monitoring has great potential for transforming how we study animal cognition and behavior. There is still a fairly large gap between the exciting prospects and what can actually be achieved in practice today.
  arXiv  Detail & Related papers  (2024-01-29T18:59:56Z)
• CattleEyeView: A Multi-task Top-down View Cattle Dataset for Smarter Precision Livestock Farming [6.291219495092237]
  We introduce CattleEyeView dataset, the first top-down view multi-task cattle video dataset. The dataset contains 753 distinct top-down cow instances in 30,703 frames. We perform benchmark experiments to evaluate the model's performance for each task.
  arXiv  Detail & Related papers  (2023-12-14T09:18:02Z)
• CVB: A Video Dataset of Cattle Visual Behaviors [13.233877352490923]
  Existing datasets for cattle behavior recognition are mostly small, lack well-defined labels, or are collected in unrealistic controlled environments. We introduce a new dataset, called Cattle Visual Behaviors (CVB), that consists of 502 video clips, each fifteen seconds long, captured in natural lighting conditions, and annotated with eleven visually perceptible behaviors of grazing cattle.
  arXiv  Detail & Related papers  (2023-05-26T00:44:11Z)
• Self-Supervised Masked Convolutional Transformer Block for Anomaly Detection [122.4894940892536]
  We present a novel self-supervised masked convolutional transformer block (SSMCTB) that comprises the reconstruction-based functionality at a core architectural level. In this work, we extend our previous self-supervised predictive convolutional attentive block (SSPCAB) with a 3D masked convolutional layer, a transformer for channel-wise attention, as well as a novel self-supervised objective based on Huber loss.
  arXiv  Detail & Related papers  (2022-09-25T04:56:10Z)
• Unsupervised Learning of Accurate Siamese Tracking [68.58171095173056]
  We present a novel unsupervised tracking framework, in which we can learn temporal correspondence both on the classification branch and regression branch. Our tracker outperforms preceding unsupervised methods by a substantial margin, performing on par with supervised methods on large-scale datasets such as TrackingNet and LaSOT.
  arXiv  Detail & Related papers  (2022-04-04T13:39:43Z)
• Zoo-Tuning: Adaptive Transfer from a Zoo of Models [82.9120546160422]
  Zoo-Tuning learns to adaptively transfer the parameters of pretrained models to the target task. We evaluate our approach on a variety of tasks, including reinforcement learning, image classification, and facial landmark detection.
  arXiv  Detail & Related papers  (2021-06-29T14:09:45Z)
• AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wild [51.35013619649463]
  We present an extensive dataset of free-running cheetahs in the wild, called AcinoSet. The dataset contains 119,490 frames of multi-view synchronized high-speed video footage, camera calibration files and 7,588 human-annotated frames. The resulting 3D trajectories, human-checked 3D ground truth, and an interactive tool to inspect the data is also provided.
  arXiv  Detail & Related papers  (2021-03-24T15:54:11Z)
• Dairy Cow rumination detection: A deep learning approach [0.8312466807725921]
  Rumination behavior is a significant variable for tracking the development and yield of animal husbandry. Modern attached devices are invasive, stressful and uncomfortable for the cattle. In this study, we introduce an innovative monitoring method using Convolution Neural Network (CNN)-based deep learning models.
  arXiv  Detail & Related papers  (2021-01-07T07:33:32Z)
• Automatic image-based identification and biomass estimation of invertebrates [70.08255822611812]
  Time-consuming sorting and identification of taxa pose strong limitations on how many insect samples can be processed. We propose to replace the standard manual approach of human expert-based sorting and identification with an automatic image-based technology. We use state-of-the-art Resnet-50 and InceptionV3 CNNs for the classification task.
  arXiv  Detail & Related papers  (2020-02-05T21:38:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.