Towards Multi-Modal Animal Pose Estimation: A Survey and In-Depth Analysis

• URL: http://arxiv.org/abs/2410.09312v2
• Date: Sat, 04 Jan 2025 20:01:22 GMT
• Title: Towards Multi-Modal Animal Pose Estimation: A Survey and In-Depth Analysis
• Authors: Qianyi Deng, Oishi Deb, Amir Patel, Christian Rupprecht, Philip Torr, Niki Trigoni, Andrew Markham,
• Abstract summary: Animal pose estimation (APE) aims to locate the animal body parts using a diverse array of sensor and modality inputs. By evaluating 176 papers since 2011, APE methods are categorised by their input sensor and modality types, output forms, learning paradigms, experimental setup, and application domains.
• Score: 48.57353513938747
• License:
• Abstract: Animal pose estimation (APE) aims to locate the animal body parts using a diverse array of sensor and modality inputs (e.g. RGB cameras, LiDAR, infrared, IMU, acoustic and language cues), which is crucial for research across neuroscience, biomechanics, and veterinary medicine. By evaluating 176 papers since 2011, APE methods are categorised by their input sensor and modality types, output forms, learning paradigms, experimental setup, and application domains, presenting detailed analyses of current trends, challenges, and future directions in single- and multi-modality APE systems. The analysis also highlights the transition between human and animal pose estimation, and how innovations in APE can reciprocally enrich human pose estimation and the broader machine learning paradigm. Additionally, 2D and 3D APE datasets and evaluation metrics based on different sensors and modalities are provided. A regularly updated project page is provided here: https://github.com/ChennyDeng/MM-APE.

Related papers

• A Survey of Models for Cognitive Diagnosis: New Developments and Future Directions [66.40362209055023]
  This paper aims to provide a survey of current models for cognitive diagnosis, with more attention on new developments using machine learning-based methods. By comparing the model structures, parameter estimation algorithms, model evaluation methods and applications, we provide a relatively comprehensive review of the recent trends in cognitive diagnosis models.
  arXiv  Detail & Related papers  (2024-07-07T18:02:00Z)
• Of Mice and Pose: 2D Mouse Pose Estimation from Unlabelled Data and Synthetic Prior [0.7499722271664145]
  We propose an approach for estimating 2D mouse body pose from unlabelled images using a synthetically generated empirical pose prior. We adapt this method to the limb structure of the mouse and generate the empirical prior of 2D poses from a synthetic 3D mouse model. In experiments on a new mouse video dataset, we evaluate the performance of the approach by comparing pose predictions to a manually obtained ground truth.
  arXiv  Detail & Related papers  (2023-07-25T09:31:55Z)
• Transformers in Healthcare: A Survey [11.189892739475633]
  Transformer is a type of deep learning architecture initially developed to solve general-purpose Natural Language Processing (NLP) tasks. We provide an overview of how this architecture has been adopted to analyze various forms of data, including medical imaging, structured and unstructured Electronic Health Records (EHR), social media, physiological signals, and biomolecular sequences. We discuss the benefits and limitations of using transformers in healthcare and examine issues such as computational cost, model interpretability, fairness, alignment with human values, ethical implications, and environmental impact.
  arXiv  Detail & Related papers  (2023-06-30T18:14:20Z)
• Domain Adaptation for Inertial Measurement Unit-based Human Activity Recognition: A Survey [1.7205106391379026]
  Machine learning-based wearable human activity recognition (WHAR) models enable the development of smart and connected community applications. The widespread adoption of these WHAR models is impeded by their degraded performance in the presence of data distribution heterogeneities. Traditional machine learning algorithms and transfer learning techniques have been proposed to address the underpinning challenges of handling such data heterogeneities. Domain adaptation is one such transfer learning techniques that has gained significant popularity in recent literature.
  arXiv  Detail & Related papers  (2023-04-07T01:33:42Z)
• CNN-Based Action Recognition and Pose Estimation for Classifying Animal Behavior from Videos: A Survey [0.0]
  Action recognition, classifying activities performed by one or more subjects in a trimmed video, forms the basis of many techniques. Deep learning models for human action recognition have progressed over the last decade. Recent interest in research that incorporates deep learning-based action recognition for classification has increased.
  arXiv  Detail & Related papers  (2023-01-15T20:54:44Z)
• Cetacean Translation Initiative: a roadmap to deciphering the communication of sperm whales [97.41394631426678]
  Recent research showed the promise of machine learning tools for analyzing acoustic communication in nonhuman species. We outline the key elements required for the collection and processing of massive bioacoustic data of sperm whales. The technological capabilities developed are likely to yield cross-applications and advancements in broader communities investigating non-human communication and animal behavioral research.
  arXiv  Detail & Related papers  (2021-04-17T18:39:22Z)
• TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild [77.59069361196404]
  TRiPOD is a novel method for predicting body dynamics based on graph attentional networks. To incorporate a real-world challenge, we learn an indicator representing whether an estimated body joint is visible/invisible at each frame. Our evaluation shows that TRiPOD outperforms all prior work and state-of-the-art specifically designed for each of the trajectory and pose forecasting tasks.
  arXiv  Detail & Related papers  (2021-04-08T20:01:00Z)
• 3D Human Body Reshaping with Anthropometric Modeling [59.51820187982793]
  Reshaping accurate and realistic 3D human bodies from anthropometric parameters poses a fundamental challenge for person identification, online shopping and virtual reality. Existing approaches for creating such 3D shapes often suffer from complex measurement by range cameras or high-end scanners. This paper proposes a novel feature-selection-based local mapping technique, which enables automatic anthropometric parameter modeling for each body facet.
  arXiv  Detail & Related papers  (2021-04-05T04:09:39Z)
• Deep Learning-Based Human Pose Estimation: A Survey [66.01917727294163]
  Human pose estimation has drawn increasing attention during the past decade. It has been utilized in a wide range of applications including human-computer interaction, motion analysis, augmented reality, and virtual reality. Recent deep learning-based solutions have achieved high performance in human pose estimation.
  arXiv  Detail & Related papers  (2020-12-24T18:49:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.