Deep Feature Deformation Weights

• URL: http://arxiv.org/abs/2601.12527v1
• Date: Sun, 18 Jan 2026 18:23:03 GMT
• Title: Deep Feature Deformation Weights
• Authors: Richard Liu, Itai Lang, Rana Hanocka,
• Abstract summary: We propose a technique that fuses semantic prior of data with the precise control and speed of traditional frameworks.<n>Our approach is surprisingly simple yet effective: deep feature proximity makes for smooth and semantic deformation weights.<n>We show a proof-of-concept application which can produce deformations for meshes up to 1 million faces in real-time on a consumer-grade machine.
• Score: 16.85663471272189
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Handle-based mesh deformation has been a long-standing paradigm in computer graphics, enabling intuitive shape edits from sparse controls. Classic techniques offer precise and rapid deformation control. However, they solve an optimization problem with constraints defined by control handle placement, requiring a user to know apriori the ideal distribution of handles on the shape to accomplish the desired edit. The mapping from handle set to deformation behavior is often unintuitive and, importantly, non-semantic. Modern data-driven methods, on the other hand, leverage a data prior to obtain semantic edits, but are slow and imprecise. We propose a technique that fuses the semantic prior of data with the precise control and speed of traditional frameworks. Our approach is surprisingly simple yet effective: deep feature proximity makes for smooth and semantic deformation weights, with no need for additional regularization. The weights can be computed in real-time for any surface point, whereas prior methods require optimization for new handles. Moreover, the semantic prior from deep features enables co-deformation of semantic parts. We introduce an improved feature distillation pipeline, barycentric feature distillation, which efficiently uses the visual signal from shape renders to minimize distillation cost. This allows our weights to be computed for high resolution meshes in under a minute, in contrast to potentially hours for both classical and neural methods. We preserve and extend properties of classical methods through feature space constraints and locality weighting. Our field representation allows for automatic detection of semantic symmetries, which we use to produce symmetry-preserving deformations. We show a proof-of-concept application which can produce deformations for meshes up to 1 million faces in real-time on a consumer-grade machine.

Related papers

• Preconditioned Deformation Grids [41.79220966392968]
  We introduce Preconditioned Deformation Grids, a novel technique for estimating coherent deformation fields directly from unstructured point cloud sequences.<n>Our method achieves superior results, particularly for long sequences, compared to state-of-the-art techniques.
  arXiv  Detail & Related papers  (2025-09-22T17:59:55Z)
• Iterative Sizing Field Prediction for Adaptive Mesh Generation From Expert Demonstrations [49.173541207550485]
  Adaptive Meshing By Expert Reconstruction (AMBER) is an imitation learning problem. AMBER combines a graph neural network with an online data acquisition scheme to predict the projected sizing field of an expert mesh. We experimentally validate AMBER on 2D meshes and 3D meshes provided by a human expert, closely matching the provided demonstrations and outperforming a single-step CNN baseline.
  arXiv  Detail & Related papers  (2024-06-20T10:01:22Z)
• General Neural Gauge Fields [100.35916421218101]
  We develop a learning framework to jointly optimize gauge transformations and neural fields. We derive an information-invariant gauge transformation which allows to preserve scene information inherently and yield superior performance.
  arXiv  Detail & Related papers  (2023-05-05T12:08:57Z)
• Neural Implicit Shape Editing using Boundary Sensitivity [12.621108702820313]
  We leverage boundary sensitivity to express how perturbations in parameters move the shape boundary. With this, we perform geometric editing: finding a parameter update that best approximates a globally prescribed deformation.
  arXiv  Detail & Related papers  (2023-04-24T13:04:15Z)
• Spatially-varying Regularization with Conditional Transformer for Unsupervised Image Registration [11.498623409184225]
  We introduce an end-to-end framework that uses neural networks to learn a deformation regularizer directly from data. The proposed method is built upon a Transformer-based model, but it can be readily adapted to any network architecture.
  arXiv  Detail & Related papers  (2023-03-10T19:11:16Z)
• DeepMLS: Geometry-Aware Control Point Deformation [76.51312491336343]
  We introduce DeepMLS, a space-based deformation technique, guided by a set of displaced control points. We leverage the power of neural networks to inject the underlying shape geometry into the deformation parameters. Our technique facilitates intuitive piecewise smooth deformations, which are well suited for manufactured objects.
  arXiv  Detail & Related papers  (2022-01-05T23:55:34Z)
• Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Camera [79.41374930171469]
  We present a novel method for real-time pose and shape reconstruction of two strongly interacting hands. Our approach combines an extensive list of favorable properties, namely it is marker-less. We show state-of-the-art results in scenes that exceed the complexity level demonstrated by previous work.
  arXiv  Detail & Related papers  (2021-06-15T11:39:49Z)
• An Adaptive Framework for Learning Unsupervised Depth Completion [59.17364202590475]
  We present a method to infer a dense depth map from a color image and associated sparse depth measurements. We show that regularization and co-visibility are related via the fitness of the model to data and can be unified into a single framework.
  arXiv  Detail & Related papers  (2021-06-06T02:27:55Z)
• Locally Aware Piecewise Transformation Fields for 3D Human Mesh Registration [67.69257782645789]
  We propose piecewise transformation fields that learn 3D translation vectors to map any query point in posed space to its correspond position in rest-pose space. We show that fitting parametric models with poses by our network results in much better registration quality, especially for extreme poses.
  arXiv  Detail & Related papers  (2021-04-16T15:16:09Z)
• Learning to Infer Semantic Parameters for 3D Shape Editing [14.902766305317202]
  We learn a deep network that infers the semantic parameters of an input shape and then allows the user to manipulate those parameters. The network is trained jointly on shapes from an auxiliary synthetic template and unlabeled realistic models. Experiments with datasets of chairs, airplanes, and human bodies demonstrate that our method produces more natural edits than prior work.
  arXiv  Detail & Related papers  (2020-11-09T20:58:49Z)
• NiLBS: Neural Inverse Linear Blend Skinning [59.22647012489496]
  We introduce a method to invert the deformations undergone via traditional skinning techniques via a neural network parameterized by pose. The ability to invert these deformations allows values (e.g., distance function, signed distance function, occupancy) to be pre-computed at rest pose, and then efficiently queried when the character is deformed.
  arXiv  Detail & Related papers  (2020-04-06T20:46:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.