Efficient Human-Contact Representation for Human-Scene Interaction

• URL: http://arxiv.org/abs/2608.09388v1
• Date: Mon, 10 Aug 2026 10:09:27 GMT
• Title: Efficient Human-Contact Representation for Human-Scene Interaction
• Abstract summary: We propose a new efficient human-contact representation for human-scene interaction.<n>Our primary contribution is the introduction of sparse contact masks that strategically select essential contact information.<n>Our approach not only enhances computational speed but also filters out non-essential contact data, thereby improving the precision of human-scene interaction models.
• Score: 12.167906663714666
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Human-scene interaction is an active research topic with several industrial applications in virtual reality, gaming, robotics, and surveillance. Despite significant progress in network architectures to improve the results or optimize models' parameters for fast inference speed, the efficient representation of contact between humans and their environments remains an open challenge. In this paper, we propose a new efficient human-contact representation for human-scene interaction. Our primary contribution is the introduction of sparse contact masks that strategically select essential contact information, significantly reducing redundant data in high-dimensional inputs. Leveraging this efficient contact representation, we propose a suite of sparse operators to replace traditional dense operators within deep network layers for faster computation. Our approach not only enhances computational speed but also filters out non-essential contact data, thereby improving the precision of human-scene interaction models. To validate the effectiveness of our method, we conduct intensive experiments across three public benchmark datasets, focusing on two critical tasks for human-scene interaction: contact prediction and scene synthesis. The experimental results show that our approach outperforms state-of-the-art models in reconstruction accuracy and achieves a computation speed-up of at least 12 times over recent baselines.

Related papers

• MOCHI: Motion Enhancement of Collaborative Human-object Interactions [9.360852329235477]
  Collaborative human-object interaction shows and complex movements that require mutual anticipation and continuous adjustment between participants and the shared object.<n>We present MOCHI, a two-stage framework for enhancing noisy MHOI data.<n>Our approach first generates physically plausible hand grasps through optimization from noisy body input, producing grasps that are both physically plausible and semantically consistent with the body pose.<n>During the optimization process, we introduce optimization objectives to encode human-object and human-human interaction information within these single-person priors.
  arXiv  Detail & Related papers  (2026-06-16T17:58:44Z)
• Unleashing Guidance Without Classifiers for Human-Object Interaction Animation [54.24065561632133]
  Prior diffusion-based approaches often rely on hand-crafted contact priors or human-imposed kinematic constraints to improve contact quality.<n>We propose a data-driven alternative in which guidance emerges from the denoising pace itself, reducing dependence on manually designed priors.<n>We find that this data-driven guidance is inherently contact-aware, and can be enhanced when training is augmented with a broad spectrum of synthetic object geometries.
  arXiv  Detail & Related papers  (2026-03-26T17:59:34Z)
• Learning Whole-Body Human-Humanoid Interaction from Human-Human Demonstrations [63.80827184637476]
  We introduce D-STAR, a hierarchical policy that disentangles when to act from where to act.<n>We validate our framework through extensive and rigorous simulations.
  arXiv  Detail & Related papers  (2026-01-14T14:37:06Z)
• Improvement of Human-Object Interaction Action Recognition Using Scene Information and Multi-Task Learning Approach [0.0]
  We propose a methodology to utilize human action recognition performance by considering fixed object information in the environment.<n>The multi-task learning approach, along with interaction area information, succeeds in recognizing the studied interaction and non-interaction actions with an accuracy of 99.25%.
  arXiv  Detail & Related papers  (2025-09-11T00:14:56Z)
• Reconstructing Close Human Interaction with Appearance and Proxemics Reasoning [50.76723760768117]
  Existing human pose estimation methods cannot recover plausible close interactions from in-the-wild videos.<n>We find that human appearance can provide a straightforward cue to address these obstacles.<n>We propose a dual-branch optimization framework to reconstruct accurate interactive motions with plausible body contacts constrained by human appearances, social proxemics, and physical laws.
  arXiv  Detail & Related papers  (2025-07-03T12:19:26Z)
• Ask, Pose, Unite: Scaling Data Acquisition for Close Interactions with Vision Language Models [5.541130887628606]
  Social dynamics in close human interactions pose significant challenges for Human Mesh Estimation (HME) We introduce a novel data generation method that utilizes Large Vision Language Models (LVLMs) to annotate contact maps which guide test-time optimization to produce paired image and pseudo-ground truth meshes. This methodology not only alleviates the annotation burden but also enables the assembly of a comprehensive dataset specifically tailored for close interactions in HME.
  arXiv  Detail & Related papers  (2024-10-01T01:14:24Z)
• Learning Human Action Recognition Representations Without Real Humans [66.61527869763819]
  We present a benchmark that leverages real-world videos with humans removed and synthetic data containing virtual humans to pre-train a model. We then evaluate the transferability of the representation learned on this data to a diverse set of downstream action recognition benchmarks. Our approach outperforms previous baselines by up to 5%.
  arXiv  Detail & Related papers  (2023-11-10T18:38:14Z)
• HODN: Disentangling Human-Object Feature for HOI Detection [51.48164941412871]
  We propose a Human and Object Disentangling Network (HODN) to model the Human-Object Interaction (HOI) relationships explicitly. Considering that human features are more contributive to interaction, we propose a Human-Guide Linking method to make sure the interaction decoder focuses on the human-centric regions. Our proposed method achieves competitive performance on both the V-COCO and the HICO-Det Linking datasets.
  arXiv  Detail & Related papers  (2023-08-20T04:12:50Z)
• Using Features at Multiple Temporal and Spatial Resolutions to Predict Human Behavior in Real Time [2.955419572714387]
  We present an approach for integrating high and low-resolution spatial and temporal information to predict human behavior in real time. Our model composes neural networks for high and low-resolution feature extraction with a neural network for behavior prediction, with all three networks trained simultaneously.
  arXiv  Detail & Related papers  (2022-11-12T18:41:33Z)
• Facial Emotion Recognition using Deep Residual Networks in Real-World Environments [5.834678345946704]
  We propose a facial feature extractor model trained on an in-the-wild and massively collected video dataset. The dataset consists of a million labelled frames and 2,616 thousand subjects. As temporal information is important to the emotion recognition domain, we utilise LSTM cells to capture the temporal dynamics in the data.
  arXiv  Detail & Related papers  (2021-11-04T10:08:22Z)
• Human Trajectory Forecasting in Crowds: A Deep Learning Perspective [89.4600982169]
  We present an in-depth analysis of existing deep learning-based methods for modelling social interactions. We propose two knowledge-based data-driven methods to effectively capture these social interactions. We develop a large scale interaction-centric benchmark TrajNet++, a significant yet missing component in the field of human trajectory forecasting.
  arXiv  Detail & Related papers  (2020-07-07T17:19:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.