IMPACT: A Dataset for Multi-Granularity Human Procedural Action Understanding in Industrial Assembly

• URL: http://arxiv.org/abs/2604.10409v1
• Date: Sun, 12 Apr 2026 02:09:19 GMT
• Title: IMPACT: A Dataset for Multi-Granularity Human Procedural Action Understanding in Industrial Assembly
• Abstract summary: IMPACT is a synchronized five-view RGB-D dataset for deployment-oriented industrial procedural understanding.<n>It is built around real assembly and disassembly of a commercial angle grinder with professional-grade tools.
• Score: 79.737814043505
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce IMPACT, a synchronized five-view RGB-D dataset for deployment-oriented industrial procedural understanding, built around real assembly and disassembly of a commercial angle grinder with professional-grade tools. To our knowledge, IMPACT is the first real industrial assembly benchmark that jointly provides synchronized ego-exo RGB-D capture, decoupled bimanual annotation, compliance-aware state tracking, and explicit anomaly--recovery supervision within a single real industrial workflow. It comprises 112 trials from 13 participants totaling 39.5 hours, with multi-route execution governed by a partial-order prerequisite graph, a six-category anomaly taxonomy, and operator cognitive load measured via NASA-TLX. The annotation hierarchy links hand-specific atomic actions to coarse procedural steps, component assembly states, and per-hand compliance phases, with synchronized null spans across views to decouple perceptual limitations from algorithmic failure. Systematic baselines reveal fundamental limitations that remain invisible to single-task benchmarks, particularly under realistic deployment conditions that involve incomplete observations, flexible execution paths, and corrective behavior. The full dataset, annotations, and evaluation code are available at https://github.com/Kratos-Wen/IMPACT.

Related papers

• Inter-X++: A Comprehensive Benchmark for Multimodal Human-Human Interaction Analysis [55.78822230833247]
  We present Inter-X++, a comprehensive and large-scale benchmark designed to empower versatile HHI analysis.<n>Inter-X++ provides 11,388 high-fidelity interaction sequences and over 8.1M frames, featuring precise whole-body movements and detailed finger articulations.<n>We propose OpenHHI, a single and unified HHI representation and modeling framework that jointly optimize interaction reconstruction and semantic understanding.
  arXiv  Detail & Related papers  (2026-08-20T17:51:48Z)
• Compositional Benchmark Synthesis for Hierarchical Human Action Recognition [4.812022454180755]
  A benchmark-generation and evaluation frameworkis proposed that synthesizes a four-level hierarchical-intention benchmark.<n> Episodes are assembled by a transition model under a subject-consistency constraint.<n>A coverage-aware sampler reduces the subject usage Gini from 0.566 to 0.248.
  arXiv  Detail & Related papers  (2026-08-11T10:22:22Z)
• From Benchmark Performance to Tool Deployment: Human-in-the-Loop Anomaly Detection [28.67239775192971]
  We evaluate 19 unsupervised anomaly detection models on the BowTie dataset.<n>We observe that model performance is less stable than typically reported on standard benchmarks.<n>We deploy a unified human-in-the-loop framework for manufactured-part inspection.
  arXiv  Detail & Related papers  (2026-08-07T21:31:20Z)
• Unified Video Dense Prediction from Disjoint Data [71.9957801898161]
  We introduce UniD, a unified video model that jointly predicts eight dense scene properties-depth, surface normals, semantic segmentation, boundaries, human parts, albedo, shading, and materials.<n>We propose a simple yet effective distillation step in which per-task experts supervise a unified backbone through lightweight task projectors.<n>UniD achieves competitive performance against per-task specialists and multi-task baselines.
  arXiv  Detail & Related papers  (2026-07-23T17:59:50Z)
• REAL-OW: Rehearsal-free Open World Object Detection with Low-Rank Adaptation and Dual-Stage Objectness Modeling [56.888597798431704]
  Open-World Object Detection (OWOD) requires detectors to identify previously unseen objects as unknown and incrementally incorporate them into the set of known categories.<n>Existing frameworks rely heavily on exemplar replay to mitigate catastrophic forgetting, but in some real applications, storing raw data conflicts with data access restrictions and leads to data exposure risks.<n>We propose REAL-OW, a novel rehearsal-free framework that decouples incremental knowledge through a collaborative adapter architecture.
  arXiv  Detail & Related papers  (2026-07-03T06:38:54Z)
• FoodMonitor: Benchmarking MLLMs for Explainable Compliance Analysis [29.80090524705393]
  FoodMonitor is a benchmark for explainable compliance analysis in commercial kitchen surveillance.<n>The best-performing model achieves only 0.360 $C_textscore$, with spatial localization and fine-grained rule understanding emerging as the primary bottlenecks.
  arXiv  Detail & Related papers  (2026-05-23T10:19:41Z)
• FORGE: Fine-grained Multimodal Evaluation for Manufacturing Scenarios [58.34124792457706]
  The manufacturing sector is increasingly adopting Multimodal Large Language Models (MLLMs) to transition from simple perception to autonomous execution.<n>Progress is hindered by data scarcity and a lack of fine-grained domain semantics in existing datasets.<n>We first construct a high-quality dataset that combines realworld 2D images and 3D point clouds, annotated with fine-grained domain semantics.<n>We then evaluate 18 state-of-the-art MLLMs across three manufacturing tasks, namely verification, structural surface inspection, and assembly verification, revealing significant performance gaps.
  arXiv  Detail & Related papers  (2026-04-08T12:23:27Z)
• Real-time Appearance-based Gaze Estimation for Open Domains [15.195617974731766]
  We propose a robust AGE framework that enhances generalization without requiring additional human-annotated data.<n>To mitigate the impact of anisotropic inter-dataset label deviation, we reformulate gaze regression as a multi-task learning problem.<n>Our MobileNet-based lightweight model generalization achieves performance competitive with the state-of-the-art (SOTA) UniGaze-H.
  arXiv  Detail & Related papers  (2026-03-27T19:33:18Z)
• MedSPOT: A Workflow-Aware Sequential Grounding Benchmark for Clinical GUI [0.7552557021953206]
  We introduce MedSPOT, a workflow-aware sequential grounding benchmark for clinical GUI environments.<n> benchmark comprises 216 task-driven videos with 597 annotateds, in which each task consists of 2 to 3 interdependent grounding steps.<n>We also introduce a comprehensive failure taxonomy, including edge bias, small-target errors, no prediction, near miss, far miss, and toolbar confusion.
  arXiv  Detail & Related papers  (2026-03-20T14:43:53Z)
• Embedding-Aware Feature Discovery: Bridging Latent Representations and Interpretable Features in Event Sequences [5.03287845497428]
  Industrial financial systems operate on temporal event sequences such as transactions, user actions, and system logs.<n>We introduce Embedding-Aware Feature Discovery (EAFD), a unified framework that bridges the gap between learned embeddings and feature-based pipelines.<n>EAFD iteratively discovers, evaluates, and refines features directly from raw event sequences using two complementary criteria.
  arXiv  Detail & Related papers  (2026-03-16T14:29:26Z)
• SOPRAG: Multi-view Graph Experts Retrieval for Industrial Standard Operating Procedures [15.42553917257021]
  SOPRAG is a novel framework specifically designed to address the pain points in SOP retrieval.<n> SOPRAG replaces flat chunking with specialized Entity, Causal, and Flow graph experts.<n> SOPRAG significantly outperforms strong lexical, dense, and graph-based RAG baselines in both retrieval accuracy and response utility.
  arXiv  Detail & Related papers  (2026-02-02T09:30:43Z)
• Labels Matter More Than Models: Quantifying the Benefit of Supervised Time Series Anomaly Detection [56.302586730134806]
  Time series anomaly detection (TSAD) is a critical data mining task often constrained by label scarcity.<n>Current research predominantly focuses on Unsupervised Time-series Anomaly Detection.<n>This paper challenges the premise that architectural complexity is the optimal path for TSAD.
  arXiv  Detail & Related papers  (2025-11-20T08:32:49Z)
• Optimizing Multitask Industrial Processes with Predictive Action Guidance [3.5212368599166703]
  We introduce the Multi-Modal Transformer Fusion and Recurrent Units (MMTFRU) Network for egocentric activity anticipation.<n>The system provides proactive operator guidance, preventing deviations in the assembly process.<n>Our approach is validated on the industrial Meccano dataset and the largescale EPIC-Kitchens-55 dataset.
  arXiv  Detail & Related papers  (2025-01-09T09:56:33Z)
• Code-as-Monitor: Constraint-aware Visual Programming for Reactive and Proactive Robotic Failure Detection [56.66677293607114]
  We propose Code-as-Monitor (CaM) for both open-set reactive and proactive failure detection.<n>To enhance the accuracy and efficiency of monitoring, we introduce constraint elements that abstract constraint-related entities.<n>Experiments show that CaM achieves a 28.7% higher success rate and reduces execution time by 31.8% under severe disturbances.
  arXiv  Detail & Related papers  (2024-12-05T18:58:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.