KnockGS:interaction-Grounded Calibrationof Physical Gaussian Representations
- URL: http://arxiv.org/abs/2608.27365v1
- Date: Thu, 27 Aug 2026 17:03:38 GMT
- Title: KnockGS:interaction-Grounded Calibrationof Physical Gaussian Representations
- Abstract summary: Existing pipelines assume that material parameters are known or manually specified, limiting their applicability.<n>We propose KnockGS, an interaction-response PhysicalGS framework that estimates the elasticity and density scales of a 3D Gaussian object.<n>We evaluate the framework on both parameter recovery and response-level fidelity.
- Score: 18.91338452575849
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Physics-integrated 3D Gaussian representations now allow reconstructed deformable objects to be simulated and rendered under explicit material models. Existing pipelines, however, assume that material parameters are known or manually specified, limiting their applicability when these parameters must be inferred from observed object dynamics. We propose KnockGS, an interaction-response PhysicalGS framework that estimates the elasticity and density scales of a 3D Gaussian object from its dynamics under a known applied force. Rather than treating physical simulation only as a forward process, we turn the force-induced response into a calibration signal: temporal response features are xtracted from the observed dynamics, the two material scales are estimated from those features, and the estimate is then frozen and written back into the same simulator so that it can be tested on an interaction it was never fitted to.We evaluate the framework on both parameter recovery and response-level fidelity. The estimated scales are compared against hidden ground truth, and the re-simulated object is measured against the target using 3D particle trajectories, response-curve statistics, and rendered-frame quality. Across five held-out material targets, our method recovers the scales substantially more accurately than response retrieval, global regression, or a fixed default material, and the frozen estimate remains predictive under interactions that differ in direction and in magnitude. Interaction response therefore carries enough information to calibrate material scales in physically grounded 3D Gaussian representations.Our study is a first step toward interactive PhysicalGS systems that calibrate a Gaussian asset whose rendered appearance and simulated response are consistent.
Related papers
- GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Models [66.77745044586173]
GAUGE is a real-world-grounded diagnostic benchmark for evaluating how numerical simulators and generative video world models reproduce or deviate from real-world physics.<n>We benchmark Isaac Sim, Genesis, and Newton on 14 task families using generalized trajectory errors, and evaluate 6 image-to-video models on 5 rigid-body tasks.<n>Our results reveal no uniformly faithful physics engine, with the largest discrepancies arising in impulsive contact, rapid textile motion, and volumetric deformation.
arXiv Detail & Related papers (2026-08-06T12:19:38Z) - PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics [6.7982839614843575]
PhysCoRe is a physics-corrected residual world model that couples a differentiable Material Point Method simulator with two feed-forward neural networks.<n>A material refinement module infers per-particle elasticity from visual observations, grounding the simulator in object-specific physics.<n>A residual correction module, Residual from Dynamics (RfD), learns the discrepancy and predicts corrections to the simulator's internal dynamics.
arXiv Detail & Related papers (2026-07-22T18:25:57Z) - PhysiFormer: Learning to Simulate Mechanics in World Space [56.16644631495]
We present PhysiFormer, a diffusion transformer for physically-plausible 3D object motion.<n>It represents objects as 3D meshes expressed in world coordinates.<n>It substantially outperforms autoregressive baselines in trajectory accuracy, rigidity preservation, and momentum-based physical consistency.
arXiv Detail & Related papers (2026-06-25T17:59:00Z) - PhyCo: Learning Controllable Physical Priors for Generative Motion [55.59209981836171]
We present PhyCo, a framework that introduces continuous, interpretable, and physically grounded control into video generation.<n>Our approach integrates three key components: (i) a large-scale dataset of over 100K photorealistic simulation videos where friction, restitution, deformation, and force are systematically varied across diverse scenarios; (ii) physics-supervised fine-tuning of a pretrained diffusion model using a ControlNet conditioned on pixel-aligned physical property maps; and (iii) VLM-guided reward optimization, where a fine-tuned vision-language model evaluates generated videos with targeted physics queries and provides differentiable feedback.
arXiv Detail & Related papers (2026-04-30T17:53:03Z) - PAD-Hand: Physics-Aware Diffusion for Hand Motion Recovery [8.428762763310232]
We propose a physics-aware conditional diffusion framework that refines noisy pose sequences into physically plausible hand motion.<n>Building on a MeshCNN-Transformer backbone, we formulate Euler-Lagrange dynamics for articulated hands.<n>Our method produces per-joint, per-time variances that measure physics consistency and offer interpretable variance maps.
arXiv Detail & Related papers (2026-03-27T04:39:21Z) - i-PhysGaussian: Implicit Physical Simulation for 3D Gaussian Splatting [60.46736489360263]
i-PhysGaussian is a framework that couples 3D Gaussian Splatting (3DGS) with an implicit Material Point Method (MPM) integrator.<n>Unlike explicit methods, our solution obtains an end-of-step state by minimizing a momentum-balance residual.<n>Results demonstrate that i-PhysGaussian maintains stability at up to 20x larger time steps than explicit baselines.
arXiv Detail & Related papers (2026-02-19T06:38:35Z) - GaussianProperty: Integrating Physical Properties to 3D Gaussians with LMMs [21.3615403516602]
Estimating physical properties for visual data is a crucial task in computer vision, graphics, and robotics.<n>We introduce GaussianProperty, a training-free framework that assigns physical properties of materials to 3D Gaussians.<n>We demonstrate that 3D Gaussians with physical property annotations enable applications in physics-based dynamic simulation and robotic grasping.
arXiv Detail & Related papers (2024-12-15T17:44:10Z) - GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulation [60.33467489955188]
This paper studies the problem of estimating physical properties (system identification) through visual observations.
To facilitate geometry-aware guidance in physical property estimation, we introduce a novel hybrid framework.
We propose a new dynamic 3D Gaussian framework based on motion factorization to recover the object as 3D Gaussian point sets.
In addition to the extracted object surfaces, the Gaussian-informed continuum also enables the rendering of object masks during simulations.
arXiv Detail & Related papers (2024-06-21T07:37:17Z) - Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussians [23.572267290979045]
Spring-Gaus is a 3D physical object representation for reconstructing and simulating elastic objects from videos of the object from multiple viewpoints.
We develop and integrate a 3D Spring-Mass model into 3D Gaussian kernels, enabling the reconstruction of the visual appearance, shape, and physical dynamics of the object.
We evaluate Spring-Gaus on both synthetic and real-world datasets, demonstrating accurate reconstruction and simulation of elastic objects.
arXiv Detail & Related papers (2024-03-14T14:25:10Z) - DeepSimHO: Stable Pose Estimation for Hand-Object Interaction via
Physics Simulation [81.11585774044848]
We present DeepSimHO, a novel deep-learning pipeline that combines forward physics simulation and backward gradient approximation with a neural network.
Our method noticeably improves the stability of the estimation and achieves superior efficiency over test-time optimization.
arXiv Detail & Related papers (2023-10-11T05:34:36Z) - Gaining a Sense of Touch. Physical Parameters Estimation using a Soft
Gripper and Neural Networks [3.0892724364965005]
There is not enough research on physical parameters estimation using deep learning algorithms on measurements from direct interaction with objects using robotic grippers.
We propose a trainable system for the regression of a stiffness coefficient and provided extensive experiments using the physics simulator environment.
Our system can reliably estimate the stiffness of an object using the Yale OpenHand soft gripper based on readings from Inertial Measurement Units (IMUs) attached to its fingers.
arXiv Detail & Related papers (2020-03-02T11:56:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.