DEEVA: A Deep Learning and IoT Based Computer Vision System to Address
Safety and Security of Production Sites in Energy Industry
- URL: http://arxiv.org/abs/2003.01196v1
- Date: Mon, 2 Mar 2020 21:26:00 GMT
- Title: DEEVA: A Deep Learning and IoT Based Computer Vision System to Address
Safety and Security of Production Sites in Energy Industry
- Authors: Nimish M. Awalgaonkar, Haining Zheng, Christopher S. Gurciullo
- Abstract summary: This paper tackles various computer vision related problems such as scene classification, object detection in scenes, semantic segmentation, scene captioning etc.
We developed Deep ExxonMobil Eye for Video Analysis (DEEVA) package to handle scene classification, object detection, semantic segmentation and captioning of scenes.
The results reveal that transfer learning with the RetinaNet object detector is able to detect the presence of workers, different types of vehicles/construction equipment, safety related objects at a high level of accuracy (above 90%)
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: When it comes to addressing the safety/security related needs at different
production/construction sites, accurate detection of the presence of workers,
vehicles, equipment important and formed an integral part of computer
vision-based surveillance systems (CVSS). Traditional CVSS systems focus on the
use of different computer vision and pattern recognition algorithms overly
reliant on manual extraction of features and small datasets, limiting their
usage because of low accuracy, need for expert knowledge and high computational
costs. The main objective of this paper is to provide decision makers at sites
with a practical yet comprehensive deep learning and IoT based solution to
tackle various computer vision related problems such as scene classification,
object detection in scenes, semantic segmentation, scene captioning etc. Our
overarching goal is to address the central question of What is happening at
this site and where is it happening in an automated fashion minimizing the need
for human resources dedicated to surveillance. We developed Deep ExxonMobil Eye
for Video Analysis (DEEVA) package to handle scene classification, object
detection, semantic segmentation and captioning of scenes in a hierarchical
approach. The results reveal that transfer learning with the RetinaNet object
detector is able to detect the presence of workers, different types of
vehicles/construction equipment, safety related objects at a high level of
accuracy (above 90%). With the help of deep learning to automatically extract
features and IoT technology to automatic capture, transfer and process vast
amount of realtime images, this framework is an important step towards the
development of intelligent surveillance systems aimed at addressing myriads of
open ended problems in the realm of security/safety monitoring, productivity
assessments and future decision making.
Related papers
- Enhancing Automata Learning with Statistical Machine Learning: A Network Security Case Study [4.2751988244805466]
In this paper, we use automata learning to derive state machines from network-traffic data.
We apply our approach to a commercial network intrusion detection system developed by our industry partner, RabbitRun Technologies.
Our approach results in an average 67.5% reduction in the number of states and transitions of the learned state machines.
arXiv Detail & Related papers (2024-05-18T02:10:41Z) - Sparse Federated Training of Object Detection in the Internet of
Vehicles [13.864554148921826]
Object detection is one of the key technologies in the Internet of Vehicles (IoV)
Current object detection methods are mostly based on centralized deep training, that is, the sensitive data obtained by edge devices need to be uploaded to the server.
We propose a federated learning-based framework, where well-trained local models are shared in the central server.
arXiv Detail & Related papers (2023-09-07T08:58:41Z) - Camera-Radar Perception for Autonomous Vehicles and ADAS: Concepts,
Datasets and Metrics [77.34726150561087]
This work aims to carry out a study on the current scenario of camera and radar-based perception for ADAS and autonomous vehicles.
Concepts and characteristics related to both sensors, as well as to their fusion, are presented.
We give an overview of the Deep Learning-based detection and segmentation tasks, and the main datasets, metrics, challenges, and open questions in vehicle perception.
arXiv Detail & Related papers (2023-03-08T00:48:32Z) - Ensemble learning techniques for intrusion detection system in the
context of cybersecurity [0.0]
Intrusion Detection System concept was used with the application of the Data Mining and Machine Learning Orange tool to obtain better results.
The main objective of the study was to investigate the Ensemble Learning technique using the Stacking method, supported by the Support Vector Machine (SVM) and kNearest Neighbour (kNN) algorithms.
arXiv Detail & Related papers (2022-12-21T10:50:54Z) - Remote Sensing Image Classification using Transfer Learning and
Attention Based Deep Neural Network [59.86658316440461]
We propose a deep learning based framework for RSISC, which makes use of the transfer learning technique and multihead attention scheme.
The proposed deep learning framework is evaluated on the benchmark NWPU-RESISC45 dataset and achieves the best classification accuracy of 94.7%.
arXiv Detail & Related papers (2022-06-20T10:05:38Z) - Multi Agent System for Machine Learning Under Uncertainty in Cyber
Physical Manufacturing System [78.60415450507706]
Recent advancements in predictive machine learning has led to its application in various use cases in manufacturing.
Most research focused on maximising predictive accuracy without addressing the uncertainty associated with it.
In this paper, we determine the sources of uncertainty in machine learning and establish the success criteria of a machine learning system to function well under uncertainty.
arXiv Detail & Related papers (2021-07-28T10:28:05Z) - Federated Learning for Intrusion Detection System: Concepts, Challenges
and Future Directions [0.20236506875465865]
Intrusion detection systems play a significant role in ensuring security and privacy of smart devices.
The present paper aims to present an extensive and exhaustive review on the use of FL in intrusion detection system.
arXiv Detail & Related papers (2021-06-16T13:13:04Z) - Towards AIOps in Edge Computing Environments [60.27785717687999]
This paper describes the system design of an AIOps platform which is applicable in heterogeneous, distributed environments.
It is feasible to collect metrics with a high frequency and simultaneously run specific anomaly detection algorithms directly on edge devices.
arXiv Detail & Related papers (2021-02-12T09:33:00Z) - Dos and Don'ts of Machine Learning in Computer Security [74.1816306998445]
Despite great potential, machine learning in security is prone to subtle pitfalls that undermine its performance.
We identify common pitfalls in the design, implementation, and evaluation of learning-based security systems.
We propose actionable recommendations to support researchers in avoiding or mitigating the pitfalls where possible.
arXiv Detail & Related papers (2020-10-19T13:09:31Z) - Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for
Online Collision Avoidance [95.86944752753564]
We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties.
Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates.
The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
arXiv Detail & Related papers (2020-07-28T07:34:30Z) - Deep Learning Models for Visual Inspection on Automotive Assembling Line [2.594420805049218]
This paper proposes the use of deep learning-based methodologies to assist in visual inspection tasks.
The proposed approach is illustrated by four proofs of concept in a real automotive assembly line.
arXiv Detail & Related papers (2020-07-02T20:00:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.