Elevator, Escalator or Neither? Classifying Pedestrian Conveyor State Using Inertial Navigation System

• URL: http://arxiv.org/abs/2405.03218v2
• Date: Sun, 13 Oct 2024 03:47:56 GMT
• Title: Elevator, Escalator or Neither? Classifying Pedestrian Conveyor State Using Inertial Navigation System
• Abstract summary: Knowing a pedestrian's conveyor state of "elevator," "escalator," or "neither" is fundamental in many applications such as indoor navigation and people flow management. We study, for the first time, classifying the conveyor state of a pedestrian, given the multimodal INS (inertial navigation system) readings of accelerometer, gyroscope and magnetometer sampled from the pedestrian phone. We propose ELESON, a novel, effective and lightweight INS-based deep learning approach to classify whether a pedestrian is in an elevator, escalator or neither.
• Score: 12.796931853596902
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Knowing a pedestrian's conveyor state of "elevator," "escalator," or "neither" is fundamental in many applications such as indoor navigation and people flow management. We study, for the first time, classifying the conveyor state of a pedestrian, given the multimodal INS (inertial navigation system) readings of accelerometer, gyroscope and magnetometer sampled from the pedestrian phone. This problem is challenging because the INS signals of the conveyor state are entangled with unpredictable independent pedestrian motions, confusing the classification process. We propose ELESON, a novel, effective and lightweight INS-based deep learning approach to classify whether a pedestrian is in an elevator, escalator or neither. ELESON utilizes a causal feature extractor to disentangle the conveyor state from pedestrian motion, and a magnetic feature extractor to capture the unique magnetic characteristics of moving elevators and escalators. Given the results of the extractors, it then employs an evidential state classifier to estimate the confidence of the conveyor states. Based on extensive experiments conducted on real pedestrian data, we demonstrate that ELESON outperforms significantly previous INS-based classification approaches, achieving 14% improvement in F1 score, strong confidence discriminability of 0.81 in AUROC (Area Under the Receiver Operating Characteristics), and low computational and memory requirements for smartphone deployment.

Related papers

• Reliable Heading Tracking for Pedestrian Road Crossing Prediction Using Commodity Devices [17.213711945639847]
  We propose a new heading tracking algorithm, the Orientation-Heading Alignment (OHA), which leverages a key insight: people tend to carry smartphones in certain ways due to habits, such as swinging them while walking. We apply OHA to a challenging task: predicting when pedestrians are about to cross the road to improve road user safety. Our evaluation shows that OHA achieves 3.4 times smaller heading errors across nine scenarios than existing methods.
  arXiv  Detail & Related papers  (2024-10-08T22:12:18Z)
• Predicting and Analyzing Pedestrian Crossing Behavior at Unsignalized Crossings [3.373568134827475]
  We propose and evaluate machine learning models to predict gap selection in non-zebra scenarios and zebra crossing usage in zebra scenarios. We discuss how pedestrians' behaviors are influenced by various factors, including pedestrian waiting time, walking speed, the number of unused gaps, the largest missed gap, and the influence of other pedestrians.
  arXiv  Detail & Related papers  (2024-04-15T08:36:40Z)
• TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving [46.409930329699336]
  We propose TransFuser, a mechanism to integrate image and LiDAR representations using self-attention. Our approach uses transformer modules at multiple resolutions to fuse perspective view and bird's eye view feature maps. We experimentally validate its efficacy on a challenging new benchmark with long routes and dense traffic, as well as the official leaderboard of the CARLA urban driving simulator.
  arXiv  Detail & Related papers  (2022-05-31T17:57:19Z)
• Pedestrian Stop and Go Forecasting with Hybrid Feature Fusion [87.77727495366702]
  We introduce the new task of pedestrian stop and go forecasting. Considering the lack of suitable existing datasets for it, we release TRANS, a benchmark for explicitly studying the stop and go behaviors of pedestrians in urban traffic. We build it from several existing datasets annotated with pedestrians' walking motions, in order to have various scenarios and behaviors.
  arXiv  Detail & Related papers  (2022-03-04T18:39:31Z)
• A Machine Learning Smartphone-based Sensing for Driver Behavior Classification [1.552282932199974]
  We propose to collect data sensors available in smartphones (Accelerometer, Gyroscope, GPS) in order to classify the driver behavior using speed, acceleration, direction, the 3-axis rotation angles (Yaw, Pitch, Roll) Secondly, after fusing inter-axial data from multiple sensors into a single file, we explore different machine learning algorithms for time series classification to evaluate which algorithm results in the highest performance.
  arXiv  Detail & Related papers  (2022-02-01T10:12:36Z)
• Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond [82.37430109152383]
  We show that, current pedestrian detectors poorly handle even small domain shifts in cross-dataset evaluation. We attribute the limited generalization to two main factors, the method and the current sources of data. We propose a progressive fine-tuning strategy which improves generalization.
  arXiv  Detail & Related papers  (2022-01-10T06:00:26Z)
• Pedestrian Trajectory Prediction via Spatial Interaction Transformer Network [7.150832716115448]
  In traffic scenes, when encountering with oncoming people, pedestrians may make sudden turns or stop immediately. To predict such unpredictable trajectories, we can gain insights into the interaction between pedestrians. We present a novel generative method named Spatial Interaction Transformer (SIT), which learns the correlation of pedestrian trajectories through attention mechanisms.
  arXiv  Detail & Related papers  (2021-12-13T13:08:04Z)
• PSI: A Pedestrian Behavior Dataset for Socially Intelligent Autonomous Car [47.01116716025731]
  This paper proposes and shares another benchmark dataset called the IUPUI-CSRC Pedestrian Situated Intent (PSI) data. The first novel label is the dynamic intent changes for the pedestrians to cross in front of the ego-vehicle, achieved from 24 drivers. The second one is the text-based explanations of the driver reasoning process when estimating pedestrian intents and predicting their behaviors.
  arXiv  Detail & Related papers  (2021-12-05T15:54:57Z)
• Learning-Based UE Classification in Millimeter-Wave Cellular Systems With Mobility [67.81523988596841]
  Millimeter-wave cellular communication requires beamforming procedures that enable alignment of the transmitter and receiver beams as the user equipment (UE) moves. For efficient beam tracking it is advantageous to classify users according to their traffic and mobility patterns. Research to date has demonstrated efficient ways of machine learning based UE classification.
  arXiv  Detail & Related papers  (2021-09-13T12:00:45Z)
• Benchmarking high-fidelity pedestrian tracking systems for research, real-time monitoring and crowd control [55.41644538483948]
  High-fidelity pedestrian tracking in real-life conditions has been an important tool in fundamental crowd dynamics research. As this technology advances, it is becoming increasingly useful also in society. To successfully employ pedestrian tracking techniques in research and technology, it is crucial to validate and benchmark them for accuracy. We present and discuss a benchmark suite, towards an open standard in the community, for privacy-respectful pedestrian tracking techniques.
  arXiv  Detail & Related papers  (2021-08-26T11:45:26Z)
• Pedestrian Motion State Estimation From 2D Pose [3.189006905282788]
  Traffic violation and the flexible and changeable nature of pedestrians make it more difficult to predict pedestrian behavior or intention. In combination with pedestrian motion state and other influencing factors, pedestrian intention can be predicted to avoid unnecessary accidents. This paper verifies the proposed algorithm on the JAAD public dataset, and the accuracy is improved by 11.6% compared with the existing method.
  arXiv  Detail & Related papers  (2021-02-27T07:00:06Z)
• Pedestrian Intention Prediction: A Multi-task Perspective [83.7135926821794]
  In order to be globally deployed, autonomous cars must guarantee the safety of pedestrians. This work tries to solve this problem by jointly predicting the intention and visual states of pedestrians. The method is a recurrent neural network in a multi-task learning approach.
  arXiv  Detail & Related papers  (2020-10-20T13:42:31Z)
• Abnormal activity capture from passenger flow of elevator based on unsupervised learning and fine-grained multi-label recognition [18.166284261575473]
  We present a work-flow which aims at capturing residents' abnormal activities through the passenger flow of elevator in multi-storey residence buildings. Camera and sensors (hall sensor, photoelectric sensor, gyro, accelerometer, barometer, and thermometer) with internet connection are mounted in elevator to collect image and data. Computer vision algorithms such as instance segmentation, multi-label recognition, embedding and clustering are applied to generalize passenger flow of elevator.
  arXiv  Detail & Related papers  (2020-06-29T08:50:20Z)
• Generalizable Pedestrian Detection: The Elephant In The Room [82.37430109152383]
  We find that existing state-of-the-art pedestrian detectors, though perform quite well when trained and tested on the same dataset, generalize poorly in cross dataset evaluation. We illustrate that diverse and dense datasets, collected by crawling the web, serve to be an efficient source of pre-training for pedestrian detection.
  arXiv  Detail & Related papers  (2020-03-19T14:14:52Z)
• Learning by Cheating [72.9701333689606]
  We show that this challenging learning problem can be simplified by decomposing it into two stages. We use the presented approach to train a vision-based autonomous driving system that substantially outperforms the state of the art. Our approach achieves, for the first time, 100% success rate on all tasks in the original CARLA benchmark, sets a new record on the NoCrash benchmark, and reduces the frequency of infractions by an order of magnitude compared to the prior state of the art.
  arXiv  Detail & Related papers  (2019-12-27T18:59:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.