Creative synthesis of kinematic mechanisms
- URL: http://arxiv.org/abs/2510.03308v2
- Date: Mon, 20 Oct 2025 16:07:47 GMT
- Title: Creative synthesis of kinematic mechanisms
- Abstract summary: We develop a planar linkages dataset using RGB image representations.<n>A shared-latent variational autoencoder is employed to explore the potential of image generative models.<n>Preliminary results demonstrate the effectiveness of image-based representations for generative mechanical design.
- Score: 6.531924777629619
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In this paper, we formulate the problem of kinematic synthesis for planar linkages as a cross-domain image generation task. We develop a planar linkages dataset using RGB image representations, covering a range of mechanisms: from simple types such as crank-rocker and crank-slider to more complex eight-bar linkages like Jansen's mechanism. A shared-latent variational autoencoder (VAE) is employed to explore the potential of image generative models for synthesizing unseen motion curves and simulating novel kinematics. By encoding the drawing speed of trajectory points as color gradients, the same architecture also supports kinematic synthesis conditioned on both trajectory shape and velocity profiles. We validate our method on three datasets of increasing complexity: a standard four-bar linkage set, a mixed set of four-bar and crank-slider mechanisms, and a complex set including multi-loop mechanisms. Preliminary results demonstrate the effectiveness of image-based representations for generative mechanical design, showing that mechanisms with revolute and prismatic joints, and potentially cams and gears, can be represented and synthesized within a unified image generation framework.
Related papers
- Automated Synthesis of Facial Mechanisms for Conversational Animatronic Robots [56.50769770726642]
State-of-the-art animatronic faces are typically tailored systems, making large-scale personalization slow and costly.<n>We propose a parametric, linkage-driven mechanical face template whose topology and actuator layout are explicitly parameterized to support systematic scaling.<n>We develop a dual-identity conversational facial motion synthesis framework that jointly models speaking and listening behaviors from audio.
arXiv Detail & Related papers (2026-07-13T15:22:46Z) - PWM-ArtGen: Part World Model for Articulated Object Generation [12.959451816311129]
Key challenge in articulated 3D object generation from a single image is accurately predicting the underlying kinematic structure.<n>Existing methods either infer kinematic parameters directly from a static image that lacks dynamic part-level kinematic relationships, or estimate parameters from visual dynamics generated from a single image.<n>We learn the joint distribution of visual dynamics and kinematic parameters and propose a unified Part World Model called-ArtGen.
arXiv Detail & Related papers (2026-07-02T11:12:29Z) - ManiSplat: Manipulation Trajectory Synthesis from Monocular Video via Decoupled 3D Gaussian Splatting [28.256286705954846]
Reconstructing dynamic and interactive 3D scenes from real-world observations remains a fundamental challenge in computer vision and robotics.<n>We introduce ManiSplat, a unified framework that reconstructs controllable and decoupled Gaussian digital twins directly from robotic videos.<n>Our approach reconstructs interaction-driven dynamic scenes with high fidelity and controllability, effectively supporting downstream robotic tasks and policy learning.
arXiv Detail & Related papers (2026-06-09T09:55:58Z) - Whole-Body Inverse Kinematics with Graph Diffusion [6.771999029809614]
Inverse kinematics (IK) is a fundamental problem in robotics, requiring the generation of joint configurations.<n>Existing approaches often struggle to generalize across diverse robot morphologies.<n>We propose GraphDiff-IK, a structure-aware graph diffusion framework for IK.
arXiv Detail & Related papers (2026-05-23T00:40:57Z) - Computer-Aided Design of Rational Motions for 4R and 6R Spatial Mechanism Synthesis [4.76285598583384]
We introduce a new scheme for seven 3D points based on cubic quaternionic Bezier curves.<n>The resulting motion admits factorization, i.e. the synthesis of a spatial six-bar mechanism.
arXiv Detail & Related papers (2026-02-24T13:58:36Z) - Towards Arbitrary Motion Completing via Hierarchical Continuous Representation [64.6525112550758]
We propose a novel parametric activation-induced hierarchical implicit representation framework, called NAME, based on Implicit Representations (INRs)<n>Our method introduces a hierarchical temporal encoding mechanism that extracts features from motion sequences at multiple temporal scales, enabling effective capture of intricate temporal patterns.
arXiv Detail & Related papers (2025-12-24T14:07:04Z) - SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledge [22.64986854574998]
Articulated 3D objects are critical for embodied AI, robotics, and interactive scene understanding.<n>We introduce SPARK, a framework for reconstructing physically consistent, kinematic part-level articulated objects from a single RGB image.
arXiv Detail & Related papers (2025-12-01T12:51:56Z) - Cortex-Synth: Differentiable Topology-Aware 3D Skeleton Synthesis with Hierarchical Graph Attention [0.0]
We present Synth Cortex, a novel end-to-end differentiable framework for joint 3D skeleton geometry and topology synthesis from single 2D images.<n>The framework integrates four synergistic modules: a pseudo 3D point cloud generator, an enhanced PointNet encoder, a skeleton coordinate decoder, and a novel Differentiable Graph Construction Network (DGCN)<n>Our experiments demonstrate state-of-the-art results with 18.7 percent improvement in MPJPE and 27.3 percent in Graph Edit Distance on ShapeNet, while reducing topological errors by 42 percent compared to previous approaches.
arXiv Detail & Related papers (2025-09-08T14:03:13Z) - HumanGenesis: Agent-Based Geometric and Generative Modeling for Synthetic Human Dynamics [60.737929335600015]
We present textbfHumanGenesis, a framework that integrates geometric and generative modeling through four collaborative agents.<n>HumanGenesis achieves state-of-the-art performance on tasks including text-guided synthesis, video reenactment, and novel-pose generalization.
arXiv Detail & Related papers (2025-08-13T14:50:19Z) - Data-Driven Dimensional Synthesis of Diverse Planar Four-bar Function Generation Mechanisms via Direct Parameterization [2.499517394718329]
We propose a data-driven framework that bypasses traditional equation-solving and optimization by leveraging supervised learning.<n>Our method combines a synthetic dataset, an LSTM-based neural network for handling sequential precision points, and a Mixture of Experts architecture tailored to different linkage types.<n> Experiments show our approach produces accurate, defect-free linkages across various configurations.
arXiv Detail & Related papers (2025-07-11T02:32:29Z) - ArticulatedGS: Self-supervised Digital Twin Modeling of Articulated Objects using 3D Gaussian Splatting [29.69981069695724]
We tackle the challenge of concurrent reconstruction at the part level with the RGB appearance and estimation of motion parameters.<n>We reconstruct the articulated object in 3D Gaussian representations with both appearance and geometry information at the same time.<n>We introduce ArticulatedGS, a self-supervised, comprehensive framework that autonomously learns to model shapes and appearances at the part level.
arXiv Detail & Related papers (2025-03-11T07:56:12Z) - Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis [58.5779956899918]
We present a method that simultaneously addresses the tasks of dynamic scene novel-view synthesis and six degree-of-freedom (6-DOF) tracking of all dense scene elements.
We follow an analysis-by-synthesis framework, inspired by recent work that models scenes as a collection of 3D Gaussians.
We demonstrate a large number of downstream applications enabled by our representation, including first-person view synthesis, dynamic compositional scene synthesis, and 4D video editing.
arXiv Detail & Related papers (2023-08-18T17:59:21Z) - GM-NeRF: Learning Generalizable Model-based Neural Radiance Fields from
Multi-view Images [79.39247661907397]
We introduce an effective framework Generalizable Model-based Neural Radiance Fields to synthesize free-viewpoint images.
Specifically, we propose a geometry-guided attention mechanism to register the appearance code from multi-view 2D images to a geometry proxy.
arXiv Detail & Related papers (2023-03-24T03:32:02Z) - MoDi: Unconditional Motion Synthesis from Diverse Data [51.676055380546494]
We present MoDi, an unconditional generative model that synthesizes diverse motions.
Our model is trained in a completely unsupervised setting from a diverse, unstructured and unlabeled motion dataset.
We show that despite the lack of any structure in the dataset, the latent space can be semantically clustered.
arXiv Detail & Related papers (2022-06-16T09:06:25Z) - Self-Similarity Priors: Neural Collages as Differentiable Fractal
Representations [73.14227103400964]
We investigate the role of learning in the automated discovery of self-similarity and in its utilization for downstream tasks.
We design a novel class of implicit operators, Neural Collages, which represent data as the parameters of a self-referential, structured transformation.
We investigate how to leverage the representations produced by Neural Collages in various tasks, including data compression and generation.
arXiv Detail & Related papers (2022-04-15T22:54:23Z) - IMAGINE: Image Synthesis by Image-Guided Model Inversion [79.4691654458141]
We introduce an inversion based method, denoted as IMAge-Guided model INvErsion (IMAGINE), to generate high-quality and diverse images.
We leverage the knowledge of image semantics from a pre-trained classifier to achieve plausible generations.
IMAGINE enables the synthesis procedure to simultaneously 1) enforce semantic specificity constraints during the synthesis, 2) produce realistic images without generator training, and 3) give users intuitive control over the generation process.
arXiv Detail & Related papers (2021-04-13T02:00:24Z) - Hierarchy Composition GAN for High-fidelity Image Synthesis [57.32311953820988]
This paper presents an innovative Hierarchical Composition GAN (HIC-GAN)
HIC-GAN incorporates image synthesis in geometry and appearance domains into an end-to-end trainable network.
Experiments on scene text image synthesis, portrait editing and indoor rendering tasks show that the proposed HIC-GAN achieves superior synthesis performance qualitatively and quantitatively.
arXiv Detail & Related papers (2019-05-12T11:11:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.