Informative Scene Decomposition for Crowd Analysis, Comparison and Simulation Guidance

• URL: http://arxiv.org/abs/2004.14107v1
• Date: Wed, 29 Apr 2020 12:03:32 GMT
• Title: Informative Scene Decomposition for Crowd Analysis, Comparison and Simulation Guidance
• Authors: Feixiang He, Yuanhang Xiang, Xi Zhao, He Wang
• Abstract summary: Crowd simulation is a central topic in several fields including graphics. With the fast-growing volume of crowd data, such a bottleneck needs to be addressed. We propose a new framework which comprehensively tackles this problem.
• Score: 10.000622844914272
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Crowd simulation is a central topic in several fields including graphics. To achieve high-fidelity simulations, data has been increasingly relied upon for analysis and simulation guidance. However, the information in real-world data is often noisy, mixed and unstructured, making it difficult for effective analysis, therefore has not been fully utilized. With the fast-growing volume of crowd data, such a bottleneck needs to be addressed. In this paper, we propose a new framework which comprehensively tackles this problem. It centers at an unsupervised method for analysis. The method takes as input raw and noisy data with highly mixed multi-dimensional (space, time and dynamics) information, and automatically structure it by learning the correlations among these dimensions. The dimensions together with their correlations fully describe the scene semantics which consists of recurring activity patterns in a scene, manifested as space flows with temporal and dynamics profiles. The effectiveness and robustness of the analysis have been tested on datasets with great variations in volume, duration, environment and crowd dynamics. Based on the analysis, new methods for data visualization, simulation evaluation and simulation guidance are also proposed. Together, our framework establishes a highly automated pipeline from raw data to crowd analysis, comparison and simulation guidance. Extensive experiments and evaluations have been conducted to show the flexibility, versatility and intuitiveness of our framework.

Related papers

• Stochastic Amortization: A Unified Approach to Accelerate Feature and Data Attribution [62.71425232332837]
  We show that training amortized models with noisy labels is inexpensive and surprisingly effective. This approach significantly accelerates several feature attribution and data valuation methods, often yielding an order of magnitude speedup over existing approaches.
  arXiv  Detail & Related papers  (2024-01-29T03:42:37Z)
• TimeGraphs: Graph-based Temporal Reasoning [64.18083371645956]
  TimeGraphs is a novel approach that characterizes dynamic interactions as a hierarchical temporal graph. Our approach models the interactions using a compact graph-based representation, enabling adaptive reasoning across diverse time scales. We evaluate TimeGraphs on multiple datasets with complex, dynamic agent interactions, including a football simulator, the Resistance game, and the MOMA human activity dataset.
  arXiv  Detail & Related papers  (2024-01-06T06:26:49Z)
• A Unified Simulation Framework for Visual and Behavioral Fidelity in Crowd Analysis [6.460475042590685]
  We present a human crowd simulator, called UniCrowd, and its associated validation pipeline. We show how the simulator can generate annotated data, suitable for computer vision tasks, in particular for detection and segmentation, as well as the related applications, as crowd counting, human pose estimation, trajectory analysis and prediction, and anomaly detection.
  arXiv  Detail & Related papers  (2023-12-05T09:43:27Z)
• Dynamic Spatio-Temporal Summarization using Information Based Fusion [3.038642416291856]
  We propose a dynamic-temporal data summarization technique that identifies informative features in key timesteps and fuses less informative ones. Unlike existing methods, our method retains both raw and summarized timesteps, ensuring a comprehensive view of information changes over time. We demonstrate the versatility of our technique across diverse datasets, encompassing particle-based flow simulations, security and surveillance applications, and biological cell interactions within the immune system.
  arXiv  Detail & Related papers  (2023-10-02T20:21:43Z)
• Eagle: Large-Scale Learning of Turbulent Fluid Dynamics with Mesh Transformers [23.589419066824306]
  Estimating fluid dynamics is a notoriously hard problem to solve. We introduce a new model, method and benchmark for the problem. We show that our transformer outperforms state-of-the-art performance on, both, existing synthetic and real datasets.
  arXiv  Detail & Related papers  (2023-02-16T12:59:08Z)
• Dynamic Latent Separation for Deep Learning [67.62190501599176]
  A core problem in machine learning is to learn expressive latent variables for model prediction on complex data. Here, we develop an approach that improves expressiveness, provides partial interpretation, and is not restricted to specific applications.
  arXiv  Detail & Related papers  (2022-10-07T17:56:53Z)
• TRoVE: Transforming Road Scene Datasets into Photorealistic Virtual Environments [84.6017003787244]
  This work proposes a synthetic data generation pipeline to address the difficulties and domain-gaps present in simulated datasets. We show that using annotations and visual cues from existing datasets, we can facilitate automated multi-modal data generation.
  arXiv  Detail & Related papers  (2022-08-16T20:46:08Z)
• SynopSet: Multiscale Visual Abstraction Set for Explanatory Analysis of DNA Nanotechnology Simulations [60.05887213349294]
  We propose a new abstraction set (SynopSet) that has a continuum of visual representations for the explanatory analysis of molecular dynamics simulations (MDS) in the DNA nanotechnology domain. This set is also designed to be capable of showing all spatial and temporal details, and all structural complexity. We have shown that our set of representations can be systematically located in a visualization space, dubbed SynopSpace.
  arXiv  Detail & Related papers  (2022-04-18T06:53:52Z)
• Towards Scale Consistent Monocular Visual Odometry by Learning from the Virtual World [83.36195426897768]
  We propose VRVO, a novel framework for retrieving the absolute scale from virtual data. We first train a scale-aware disparity network using both monocular real images and stereo virtual data. The resulting scale-consistent disparities are then integrated with a direct VO system.
  arXiv  Detail & Related papers  (2022-03-11T01:51:54Z)
• A Procedural World Generation Framework for Systematic Evaluation of Continual Learning [2.599882743586164]
  We introduce a computer graphics simulation framework that repeatedly renders only upcoming urban scene fragments. At its core lies a modular parametric generative model with adaptable generative factors.
  arXiv  Detail & Related papers  (2021-06-04T16:31:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.