Low-Power Object Counting with Hierarchical Neural Networks
- URL: http://arxiv.org/abs/2007.01369v1
- Date: Thu, 2 Jul 2020 20:13:01 GMT
- Title: Low-Power Object Counting with Hierarchical Neural Networks
- Authors: Abhinav Goel, Caleb Tung, Sara Aghajanzadeh, Isha Ghodgaonkar, Shreya
Ghosh, George K. Thiruvathukal, Yung-Hsiang Lu
- Abstract summary: Object counting takes two inputs: an image and an object query and reports the number of occurrences of the queried object.
Deep Neural Networks (DNNs) can achieve state-of-the-art accuracy in many computer vision tasks, such as object counting.
DNNs require billions of operations, making them difficult to deploy on resource-constrained, low-power devices.
- Score: 1.203768341415124
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep Neural Networks (DNNs) can achieve state-of-the-art accuracy in many
computer vision tasks, such as object counting. Object counting takes two
inputs: an image and an object query and reports the number of occurrences of
the queried object. To achieve high accuracy on such tasks, DNNs require
billions of operations, making them difficult to deploy on
resource-constrained, low-power devices. Prior work shows that a significant
number of DNN operations are redundant and can be eliminated without affecting
the accuracy. To reduce these redundancies, we propose a hierarchical DNN
architecture for object counting. This architecture uses a Region Proposal
Network (RPN) to propose regions-of-interest (RoIs) that may contain the
queried objects. A hierarchical classifier then efficiently finds the RoIs that
actually contain the queried objects. The hierarchy contains groups of visually
similar object categories. Small DNNs are used at each node of the hierarchy to
classify between these groups. The RoIs are incrementally processed by the
hierarchical classifier. If the object in an RoI is in the same group as the
queried object, then the next DNN in the hierarchy processes the RoI further;
otherwise, the RoI is discarded. By using a few small DNNs to process each
image, this method reduces the memory requirement, inference time, energy
consumption, and number of operations with negligible accuracy loss when
compared with the existing object counters.
Related papers
- A DeNoising FPN With Transformer R-CNN for Tiny Object Detection [25.892598910922004]
We propose a new framework, DeNoising FPN with Trans R-CNN (DNTR), to improve the performance of tiny object detection.
DNTR consists of an easy plug-in design, DeNoising FPN (DN-FPN), and an effective Transformer-based detector, Trans R-CNN.
We replace the obsolete R-CNN detector with a novel Trans R-CNN detector to focus on the representation of tiny objects with self-attention.
arXiv Detail & Related papers (2024-06-09T12:18:15Z) - Spatial-Temporal Graph Enhanced DETR Towards Multi-Frame 3D Object Detection [54.041049052843604]
We present STEMD, a novel end-to-end framework that enhances the DETR-like paradigm for multi-frame 3D object detection.
First, to model the inter-object spatial interaction and complex temporal dependencies, we introduce the spatial-temporal graph attention network.
Finally, it poses a challenge for the network to distinguish between the positive query and other highly similar queries that are not the best match.
arXiv Detail & Related papers (2023-07-01T13:53:14Z) - Learning cross space mapping via DNN using large scale click-through
logs [38.94796244812248]
The gap between low-level visual signals and high-level semantics has been progressively bridged by continuous development of deep neural network (DNN)
We propose a unified DNN model for image-query similarity calculation by simultaneously modeling image and query in one network.
Both the qualitative results and quantitative results on an image retrieval evaluation task with 1000 queries demonstrate the superiority of the proposed method.
arXiv Detail & Related papers (2023-02-26T09:00:35Z) - Robust Change Detection Based on Neural Descriptor Fields [53.111397800478294]
We develop an object-level online change detection approach that is robust to partially overlapping observations and noisy localization results.
By associating objects via shape code similarity and comparing local object-neighbor spatial layout, our proposed approach demonstrates robustness to low observation overlap and localization noises.
arXiv Detail & Related papers (2022-08-01T17:45:36Z) - Neural network relief: a pruning algorithm based on neural activity [47.57448823030151]
We propose a simple importance-score metric that deactivates unimportant connections.
We achieve comparable performance for LeNet architectures on MNIST.
The algorithm is not designed to minimize FLOPs when considering current hardware and software implementations.
arXiv Detail & Related papers (2021-09-22T15:33:49Z) - Low-Power Multi-Camera Object Re-Identification using Hierarchical
Neural Networks [9.884285377021044]
State-of-the-art techniques rely on large, computationally-intensive Deep Neural Networks (DNNs)
We propose a novel hierarchical DNN architecture that uses attribute labels in the training dataset to perform efficient object reID.
With a 4% loss in accuracy, our approach realizes significant resource savings: 74% less memory, 72% fewer operations, and 67% lower query latency, yielding 65% less energy consumption.
arXiv Detail & Related papers (2021-06-19T23:59:26Z) - MRDet: A Multi-Head Network for Accurate Oriented Object Detection in
Aerial Images [51.227489316673484]
We propose an arbitrary-oriented region proposal network (AO-RPN) to generate oriented proposals transformed from horizontal anchors.
To obtain accurate bounding boxes, we decouple the detection task into multiple subtasks and propose a multi-head network.
Each head is specially designed to learn the features optimal for the corresponding task, which allows our network to detect objects accurately.
arXiv Detail & Related papers (2020-12-24T06:36:48Z) - MS-RANAS: Multi-Scale Resource-Aware Neural Architecture Search [94.80212602202518]
We propose Multi-Scale Resource-Aware Neural Architecture Search (MS-RANAS)
We employ a one-shot architecture search approach in order to obtain a reduced search cost.
We achieve state-of-the-art results in terms of accuracy-speed trade-off.
arXiv Detail & Related papers (2020-09-29T11:56:01Z) - DC-NAS: Divide-and-Conquer Neural Architecture Search [108.57785531758076]
We present a divide-and-conquer (DC) approach to effectively and efficiently search deep neural architectures.
We achieve a $75.1%$ top-1 accuracy on the ImageNet dataset, which is higher than that of state-of-the-art methods using the same search space.
arXiv Detail & Related papers (2020-05-29T09:02:16Z) - A novel Region of Interest Extraction Layer for Instance Segmentation [3.5493798890908104]
This paper is motivated by the need to overcome the limitations of existing RoI extractors.
The proposed layer (called Generic RoI Extractor - GRoIE) introduces non-local building blocks and attention mechanisms to boost the performance.
GRoIE can be integrated seamlessly with every two-stage architecture for both object detection and instance segmentation tasks.
arXiv Detail & Related papers (2020-04-28T17:07:32Z) - Rethinking Object Detection in Retail Stores [55.359582952686175]
We propose a new task, simultaneously object localization and counting, abbreviated as Locount.
Locount requires algorithms to localize groups of objects of interest with the number of instances.
We collect a large-scale object localization and counting dataset with rich annotations in retail stores.
arXiv Detail & Related papers (2020-03-18T14:01:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.