Sketch2Arti: Sketch-based Articulation Modeling of CAD Objects

• URL: http://arxiv.org/abs/2604.25781v1
• Date: Tue, 28 Apr 2026 15:47:30 GMT
• Title: Sketch2Arti: Sketch-based Articulation Modeling of CAD Objects
• Abstract summary: Articulation modeling aims to infer movable parts and their motion parameters for a 3D object, enabling interactive animation, simulation, and shape editing.<n>We present Sketch2Arti, the first sketch-based articulation modeling system for CAD objects.
• Score: 21.473829850977978
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Articulation modeling aims to infer movable parts and their motion parameters for a 3D object, enabling interactive animation, simulation, and shape editing. In this paper, we present Sketch2Arti, the first sketch-based articulation modeling system for CAD objects. Our key observation is that designers naturally communicate articulation intent through lightweight sketches (e.g., arrows and strokes) that indicate how parts should move, yet translating such sketches into articulated 3D models remains largely manual. Sketch2Arti bridges this gap by enabling users to specify articulation through simple 2D sketches drawn from a chosen viewpoint. Given a CAD model and user sketches, our approach automatically discovers the corresponding movable parts and predicts their motion parameters, allowing iterative modeling of multiple articulations on complex objects with fine-grained control. Importantly, Sketch2Arti is trained in a category-agnostic manner without requiring object category information, leading to strong generalization to diverse objects beyond existing articulation datasets. Moreover, for shell models lacking interior structures, Sketch2Arti supports controllable internal completion guided by user sketches, generating plausible internal components consistent with the existing geometry and predicted motion constraints. Comprehensive experiments and user evaluations demonstrate the effectiveness, controllability, and generalization of Sketch2Arti. The code, dataset, and the prototype system are at https://arlo-yang.github.io/Sketch2Arti.

Related papers

• Instruct-Particulate: Scaling Feed-Forward 3D Object Articulation with Kinematic Control [86.64250947574749]
  Reconstructing articulated 3D objects is important for animation, gaming, and robotic simulations.<n>Recent neural networks can estimate the articulated structure of 3D objects, but their generalization remains limited by the scarcity of annotated data.<n>We introduce Instruct-Particulate, a model that takes a 3D mesh together with a target kinematic specification.
  arXiv  Detail & Related papers  (2026-06-12T17:59:36Z)
• 4-Doodle: Text to 3D Sketches that Move! [60.89021458068987]
  4-Doodle is the first training-free framework for generating dynamic 3D sketches from text.<n>Our method produces temporally realistic and structurally stable 3D sketch animations, outperforming existing baselines in both fidelity and controllability.
  arXiv  Detail & Related papers  (2025-10-29T09:33:29Z)
• SketchAnimator: Animate Sketch via Motion Customization of Text-to-Video Diffusion Models [52.15095222622447]
  We propose a novel sketch animation model SketchAnimator, which enables adding creative motion to a given sketch, like "a jumping car"<n>In stages 1 and 2, we utilize LoRA to integrate sketch appearance information and motion dynamics from the reference video into the pre-trained T2V model.<n>In the third stage, we utilize Score Distillation Sampling (SDS) to update the parameters of the Bezier curves in each sketch frame according to the acquired motion information.
  arXiv  Detail & Related papers  (2025-08-10T02:45:59Z)
• SENS: Part-Aware Sketch-based Implicit Neural Shape Modeling [124.3266213819203]
  We present SENS, a novel method for generating and editing 3D models from hand-drawn sketches. S SENS analyzes the sketch and encodes its parts into ViT patch encoding. S SENS supports refinement via part reconstruction, allowing for nuanced adjustments and artifact removal.
  arXiv  Detail & Related papers  (2023-06-09T17:50:53Z)
• What Can Human Sketches Do for Object Detection? [127.67444974452411]
  Sketches are highly expressive, inherently capturing subjective and fine-grained visual cues. A sketch-enabled object detection framework detects based on what textityou sketch -- textitthat zebra'' We show an intuitive synergy between foundation models (e.g., CLIP) and existing sketch models build for sketch-based image retrieval (SBIR) In particular, we first perform independent on both sketch branches of an encoder model to build highly generalisable sketch and photo encoders.
  arXiv  Detail & Related papers  (2023-03-27T12:33:23Z)
• SECAD-Net: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operations [21.000539206470897]
  SECAD-Net is an end-to-end neural network aimed at reconstructing compact and easy-to-edit CAD models. We show superiority over state-of-the-art alternatives including the closely related method for supervised CAD reconstruction.
  arXiv  Detail & Related papers  (2023-03-19T09:26:03Z)
• DifferSketching: How Differently Do People Sketch 3D Objects? [78.44544977215918]
  Multiple sketch datasets have been proposed to understand how people draw 3D objects. These datasets are often of small scale and cover a small set of objects or categories. We analyze the collected data at three levels, i.e., sketch-level, stroke-level, and pixel-level, under both spatial and temporal characteristics.
  arXiv  Detail & Related papers  (2022-09-19T06:52:18Z)
• TreeSketchNet: From Sketch To 3D Tree Parameters Generation [4.234843176066354]
  3D modeling of non-linear objects from stylized sketches is a challenge even for experts in computer graphics. We propose a broker system that mediates between the modeler and the 3D modelling software.
  arXiv  Detail & Related papers  (2022-07-25T16:08:05Z)
• Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single Sketch [36.10997511325458]
  We present a novel sketch-based system to bridge the concept design and digital modeling of freeform roof-like shapes. Our system allows the user to sketch the surface boundary and contour lines under axonometric projection. We propose a deep neural network to infer in real-time the underlying surface shape along with a dense conjugate direction field.
  arXiv  Detail & Related papers  (2022-01-23T21:09:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.