Panoptic Instance Segmentation on Pigs
- URL: http://arxiv.org/abs/2005.10499v1
- Date: Thu, 21 May 2020 07:36:03 GMT
- Title: Panoptic Instance Segmentation on Pigs
- Authors: Johannes Br\"unger, Maria Gentz, Imke Traulsen and Reinhard Koch
- Abstract summary: This work follows the relatively new definition of a panoptic segmentation and aims at the pixel accurate segmentation of the individual pigs.
A framework of a neural network for semantic segmentation, different network heads and postprocessing methods is presented.
The method is tested on a specially created data set with 1000 hand-labeled images and achieves detection rates of around 95%.
- Score: 0.860255319568951
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The behavioural research of pigs can be greatly simplified if automatic
recognition systems are used. Especially systems based on computer vision have
the advantage that they allow an evaluation without affecting the normal
behaviour of the animals. In recent years, methods based on deep learning have
been introduced and have shown pleasingly good results. Especially object and
keypoint detectors have been used to detect the individual animals. Despite
good results, bounding boxes and sparse keypoints do not trace the contours of
the animals, resulting in a lot of information being lost. Therefore this work
follows the relatively new definition of a panoptic segmentation and aims at
the pixel accurate segmentation of the individual pigs. For this a framework of
a neural network for semantic segmentation, different network heads and
postprocessing methods is presented. With the resulting instance segmentation
masks further information like the size or weight of the animals could be
estimated. The method is tested on a specially created data set with 1000
hand-labeled images and achieves detection rates of around 95% (F1 Score)
despite disturbances such as occlusions and dirty lenses.
Related papers
- A Self-Supervised Method for Body Part Segmentation and Keypoint Detection of Rat Images [0.0]
We propose a method that alleviates the need for manual labeling of laboratory rats.
The final system is capable of instance segmentation, keypoint detection, and body part segmentation even when the objects are heavily occluded.
arXiv Detail & Related papers (2024-05-07T20:11:07Z) - Visual Context-Aware Person Fall Detection [52.49277799455569]
We present a segmentation pipeline to semi-automatically separate individuals and objects in images.
Background objects such as beds, chairs, or wheelchairs can challenge fall detection systems, leading to false positive alarms.
We demonstrate that object-specific contextual transformations during training effectively mitigate this challenge.
arXiv Detail & Related papers (2024-04-11T19:06:36Z) - NP-SemiSeg: When Neural Processes meet Semi-Supervised Semantic
Segmentation [87.50830107535533]
Semi-supervised semantic segmentation involves assigning pixel-wise labels to unlabeled images at training time.
Current approaches to semi-supervised semantic segmentation work by predicting pseudo-labels for each pixel from a class-wise probability distribution output by a model.
In this work, we move one step forward by adapting NPs to semi-supervised semantic segmentation, resulting in a new model called NP-SemiSeg.
arXiv Detail & Related papers (2023-08-05T12:42:15Z) - Collaborative Feature Learning for Fine-grained Facial Forgery Detection
and Segmentation [56.73855202368894]
Previous work related to forgery detection mostly focuses on the entire faces.
Recent forgery methods have developed to edit important facial components while maintaining others unchanged.
We propose a collaborative feature learning approach to simultaneously detect manipulation and segment the falsified components.
arXiv Detail & Related papers (2023-04-17T08:49:11Z) - Saccade Mechanisms for Image Classification, Object Detection and
Tracking [12.751552698602744]
We examine how the saccade mechanism from biological vision can be used to make deep neural networks more efficient for classification and object detection problems.
Our proposed approach is based on the ideas of attention-driven visual processing and saccades, miniature eye movements influenced by attention.
arXiv Detail & Related papers (2022-06-10T13:50:34Z) - Occlusion-Resistant Instance Segmentation of Piglets in Farrowing Pens
Using Center Clustering Network [48.42863035798351]
We propose a novel Center Clustering Network for instance segmentation, dubbed as CClusnet-Inseg.
CClusnet-Inseg uses each pixel to predict object centers and trace these centers to form masks based on clustering results.
In all, 4,600 images were extracted from six videos collected from six farrowing pens to train and validate our method.
arXiv Detail & Related papers (2022-06-04T08:43:30Z) - Persistent Animal Identification Leveraging Non-Visual Markers [71.14999745312626]
We aim to locate and provide a unique identifier for each mouse in a cluttered home-cage environment through time.
This is a very challenging problem due to (i) the lack of distinguishing visual features for each mouse, and (ii) the close confines of the scene with constant occlusion.
Our approach achieves 77% accuracy on this animal identification problem, and is able to reject spurious detections when the animals are hidden.
arXiv Detail & Related papers (2021-12-13T17:11:32Z) - CvS: Classification via Segmentation For Small Datasets [52.821178654631254]
This paper presents CvS, a cost-effective classifier for small datasets that derives the classification labels from predicting the segmentation maps.
We evaluate the effectiveness of our framework on diverse problems showing that CvS is able to achieve much higher classification results compared to previous methods when given only a handful of examples.
arXiv Detail & Related papers (2021-10-29T18:41:15Z) - Minimizing false negative rate in melanoma detection and providing
insight into the causes of classification [0.5621251909851629]
Our goal is to bridge human and machine intelligence in melanoma detection.
We develop a classification system exploiting a combination of visual pre-processing, deep learning, and ensembling for providing explanations to experts.
arXiv Detail & Related papers (2021-02-18T07:46:34Z) - Automatic Detection and Recognition of Individuals in Patterned Species [4.163860911052052]
We develop a framework for automatic detection and recognition of individuals in different patterned species.
We use the recently proposed Faster-RCNN object detection framework to efficiently detect animals in images.
We evaluate our recognition system on zebra and jaguar images to show generalization to other patterned species.
arXiv Detail & Related papers (2020-05-06T15:29:21Z) - Learning landmark guided embeddings for animal re-identification [15.356786390476591]
We propose to improve embedding learning by exploiting body landmarks information explicitly.
Body landmarks are provided to the input of a CNN as confidence heatmaps.
We evaluate the proposed method on a large synthetic dataset and a small real dataset.
arXiv Detail & Related papers (2020-01-09T01:31:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.