Preference-Driven Active 3D Scene Representation for Robotic Inspection in Nuclear Decommissioning

• URL: http://arxiv.org/abs/2504.02161v1
• Date: Wed, 02 Apr 2025 22:20:48 GMT
• Title: Preference-Driven Active 3D Scene Representation for Robotic Inspection in Nuclear Decommissioning
• Abstract summary: We introduce a novel framework that integrates expert operator preferences into the active 3D scene representation pipeline.<n>Specifically, we employ Reinforcement Learning from Human Feedback to guide robotic path planning.<n>We validate our framework using a UR3e robotic arm for reactor tile inspection in a nuclear decommissioning scenario.
• Score: 13.808946251331365
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Active 3D scene representation is pivotal in modern robotics applications, including remote inspection, manipulation, and telepresence. Traditional methods primarily optimize geometric fidelity or rendering accuracy, but often overlook operator-specific objectives, such as safety-critical coverage or task-driven viewpoints. This limitation leads to suboptimal viewpoint selection, particularly in constrained environments such as nuclear decommissioning. To bridge this gap, we introduce a novel framework that integrates expert operator preferences into the active 3D scene representation pipeline. Specifically, we employ Reinforcement Learning from Human Feedback (RLHF) to guide robotic path planning, reshaping the reward function based on expert input. To capture operator-specific priorities, we conduct interactive choice experiments that evaluate user preferences in 3D scene representation. We validate our framework using a UR3e robotic arm for reactor tile inspection in a nuclear decommissioning scenario. Compared to baseline methods, our approach enhances scene representation while optimizing trajectory efficiency. The RLHF-based policy consistently outperforms random selection, prioritizing task-critical details. By unifying explicit 3D geometric modeling with implicit human-in-the-loop optimization, this work establishes a foundation for adaptive, safety-critical robotic perception systems, paving the way for enhanced automation in nuclear decommissioning, remote maintenance, and other high-risk environments.

Related papers

• Robot Trajectron V3: A Probabilistic Shared Control Framework for SE(3) Manipulation [5.090943130063491]
  RT-V3 is a shared control framework designed for $SE(3)$ grasping tasks.<n>It learns a prior over user intent and combines it with real-time user commands to estimate the posterior intent distribution.<n>Experiments demonstrate that RT-V3 achieves high accuracy in trajectory prediction and competitive performance in reactive planning.
  arXiv  Detail & Related papers  (2026-07-10T11:52:18Z)
• SplatCtrl: Perception-Action Coupling via Gaussian Scene Representations and Reactive Robot Control [14.952269223197751]
  This paper presents SplatCtrl, a unified framework for real-time scene reconstruction and reactive robot motion generation.<n>Building on 3D Gaussian Splatting (3D-GS), we introduce a hybrid voxel-based filtering and dynamic Gaussian relocation strategy.<n>For safe and reactive control, we propose a method for deriving continuous signed distance functions from isotropic Gaussians.
  arXiv  Detail & Related papers  (2026-07-09T21:18:39Z)
• Visual Geometry Transformer in the Wild: Distractor-Free 3D Reconstruction [77.75911117889915]
  Current end-to-end multi-view 3D reconstruction methods achieve impressive results, but rely on a restrictive static assumption.<n>This reliance on idealized inputs causes even the most advanced methods to fail in real-world settings.<n>We propose Visual Geometry Transformer in the Wild, an end-to-end framework for robust reconstruction from inconsistent views.
  arXiv  Detail & Related papers  (2026-06-22T02:52:22Z)
• SceneTeract: Agentic Functional Affordances and VLM Grounding in 3D Scenes [49.117927512531715]
  We introduce SceneTeract, a framework that verifies 3D scene functionality under agent-specific constraints.<n> SceneTeract decomposes complex activities into sequences of atomic actions and validates each step against accessibility requirements.<n>We release the SceneTeract verification suite and data to bridge perception and physical reality in embodied 3D scene understanding.
  arXiv  Detail & Related papers  (2026-03-31T14:31:18Z)
• Stein Variational Ergodic Surface Coverage with SE(3) Constraints [9.66086150551228]
  Existing trajectory methods fail to generate tractable 3D point-cloud surface targets.<n>We introduce a new approach to generate 3D point-cloud surface trajectories.<n>Our framework consistently identifies local optima compared to strong optimization-based SAO approaches.
  arXiv  Detail & Related papers  (2026-03-10T10:13:36Z)
• Generalizable Geometric Prior and Recurrent Spiking Feature Learning for Humanoid Robot Manipulation [90.90219129619344]
  This paper presents a novel R-prior-S, Recurrent Geometric-priormodal Policy with Spiking features.<n>To ground high-level reasoning in physical reality, we leverage lightweight 2D geometric inductive biases.<n>For the data efficiency issue in robotic action generation, we introduce a Recursive Adaptive Spiking Network.
  arXiv  Detail & Related papers  (2026-01-13T23:36:30Z)
• UniFField: A Generalizable Unified Neural Feature Field for Visual, Semantic, and Spatial Uncertainties in Any Scene [11.224584333257338]
  We present UniFField, a unified uncertainty-aware neural feature field that combines visual, semantic, and geometric features in a single generalizable representation.<n>We evaluate our uncertainty estimations to accurately describe the model prediction errors in scene reconstruction and semantic feature prediction.
  arXiv  Detail & Related papers  (2025-10-08T08:30:26Z)
• 3D-CDRGP: Towards Cross-Device Robotic Grasping Policy in 3D Open World [20.406334587479623]
  Cross-device research has become an urgent issue that needs to be tackled.<n>We pioneer in probing the cross-device (cameras & robotics) grasping policy in the 3D open world.<n>We introduce the SSGC-Seg module that enables category-agnostic 3D object detection.
  arXiv  Detail & Related papers  (2024-11-27T08:23:28Z)
• OccLoff: Learning Optimized Feature Fusion for 3D Occupancy Prediction [5.285847977231642]
  3D semantic occupancy prediction is crucial for ensuring the safety in autonomous driving. Existing fusion-based occupancy methods typically involve performing a 2D-to-3D view transformation on image features. We propose OccLoff, a framework that Learns to optimize Feature Fusion for 3D occupancy prediction.
  arXiv  Detail & Related papers  (2024-11-06T06:34:27Z)
• Neural Attention Field: Emerging Point Relevance in 3D Scenes for One-Shot Dexterous Grasping [34.98831146003579]
  One-shot transfer of dexterous grasps to novel scenes with object and context variations has been a challenging problem. We propose the textitneural attention field for representing semantic-aware dense feature fields in the 3D space.
  arXiv  Detail & Related papers  (2024-10-30T14:06:51Z)
• Leveraging Spatial Attention and Edge Context for Optimized Feature Selection in Visual Localization [0.0]
  We introduce an attention network that selectively targets informative regions of the image. Using this network, we identify the highest-scoring features to improve the feature selection process and combine the result with edge detection. Our approach was tested on the outdoor benchmark dataset, demonstrating superior results compared to previous methods.
  arXiv  Detail & Related papers  (2024-10-16T05:00:51Z)
• GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplane [53.388937705785025]
  3D open-vocabulary scene understanding is crucial for advancing augmented reality and robotic applications. We introduce GOI, a framework that integrates semantic features from 2D vision-language foundation models into 3D Gaussian Splatting (3DGS) Our method treats the feature selection process as a hyperplane division within the feature space, retaining only features that are highly relevant to the query.
  arXiv  Detail & Related papers  (2024-05-27T18:57:18Z)
• OccNeRF: Advancing 3D Occupancy Prediction in LiDAR-Free Environments [77.0399450848749]
  We propose an OccNeRF method for training occupancy networks without 3D supervision. We parameterize the reconstructed occupancy fields and reorganize the sampling strategy to align with the cameras' infinite perceptive range. For semantic occupancy prediction, we design several strategies to polish the prompts and filter the outputs of a pretrained open-vocabulary 2D segmentation model.
  arXiv  Detail & Related papers  (2023-12-14T18:58:52Z)
• Learning to View: Decision Transformers for Active Object Detection [18.211691238072245]
  In most robotic systems, perception is typically independent of motion planning. We use reinforcement learning (RL) methods to control the robot in order to obtain images that maximize the detection quality. We evaluate the performance of proposed method on an interactive dataset collected from an indoor scenario simulator.
  arXiv  Detail & Related papers  (2023-01-23T17:00:48Z)
• DETR4D: Direct Multi-View 3D Object Detection with Sparse Attention [50.11672196146829]
  3D object detection with surround-view images is an essential task for autonomous driving. We propose DETR4D, a Transformer-based framework that explores sparse attention and direct feature query for 3D object detection in multi-view images.
  arXiv  Detail & Related papers  (2022-12-15T14:18:47Z)
• Incremental 3D Scene Completion for Safe and Efficient Exploration Mapping and Planning [60.599223456298915]
  We propose a novel way to integrate deep learning into exploration by leveraging 3D scene completion for informed, safe, and interpretable mapping and planning. We show that our method can speed up coverage of an environment by 73% compared to the baselines with only minimal reduction in map accuracy. Even if scene completions are not included in the final map, we show that they can be used to guide the robot to choose more informative paths, speeding up the measurement of the scene with the robot's sensors by 35%.
  arXiv  Detail & Related papers  (2022-08-17T14:19:33Z)
• Semi-Perspective Decoupled Heatmaps for 3D Robot Pose Estimation from Depth Maps [66.24554680709417]
  Knowing the exact 3D location of workers and robots in a collaborative environment enables several real applications. We propose a non-invasive framework based on depth devices and deep neural networks to estimate the 3D pose of robots from an external camera.
  arXiv  Detail & Related papers  (2022-07-06T08:52:12Z)
• Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for Online Collision Avoidance [95.86944752753564]
  We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties. Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates. The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
  arXiv  Detail & Related papers  (2020-07-28T07:34:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.