BRepCLIP: Contrastive Multimodal Pretraining on BRep Primitives for CAD Understanding

• URL: http://arxiv.org/abs/2606.05515v1
• Date: Wed, 03 Jun 2026 23:41:23 GMT
• Title: BRepCLIP: Contrastive Multimodal Pretraining on BRep Primitives for CAD Understanding
• Abstract summary: We introduce BRepCLIP, the first framework to align BRep geometry with language and image embeddings.<n>A transformer encoder aggregates these tokens into a global BRep embedding, aligned with CLIP's text and image encoders.<n>BRepCLIP generates more discriminative and semantically grounded embeddings than existing point-based alternatives.
• Score: 22.960026011165706
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Learning representations of CAD models is a largely open problem. While 3D representation learning has flourished around point clouds and meshes, the native format of CAD - boundary representations BReps, which encodes exact parametric surfaces, curves, and their topology, has received little attention as a representation learning substrate. We introduce BRepCLIP, the first framework to align BRep geometry with language and image embeddings through contrastive pretraining. We model each CAD object as a sequence of face and edge tokens with separate discrete vocabularies for surface and curve geometry, augmented with spatial and semantic descriptors that capture surface types (e.g., cylindrical, torus, NURBS) and curve primitives (e.g., line, arc, B-spline). A transformer encoder aggregates these tokens into a global BRep embedding, aligned with CLIP's text and image encoders via a joint contrastive objective. BRepCLIP generates more discriminative and semantically grounded embeddings than existing point-based alternatives, improving Top-1 retrieval over OpenShape by 40.4%, 22.0%, and 23.9% on ABC, CADParser, and Automate, respectively, and improving zero-shot classification on FabWave by 15% in Top-1 score. We further demonstrate its utility as a CAD-aware similarity metric for evaluating text and image-conditioned CAD generation, establishing the importance of structure-aware pretraining for multimodal CAD understanding. Project page is available at https://muhammadusama100.github.io/BrepClip2026/

Related papers

• Autoregressive B-Rep Shape Generation with Parametric Surfaces [83.03418080213359]
  ParaCAD is an autoregressive framework for point-cloud-conditioned B-Rep generation.<n>Our model first generates parametric surfaces with constrained UV domains, and then constructs a valid B-Rep by globally intersecting these surfaces.<n>Extensive experiments demonstrate that ParaCAD produces accurate B-Reps with faithful point-cloud alignment.
  arXiv  Detail & Related papers  (2026-07-19T06:14:50Z)
• SUFLECA: Scaling Up Feature Learning for CAD-to-image Alignment [8.675679091961213]
  CAD-to-image alignment aims to estimate an object's 9D pose from a single RGB image.<n>Recent zero-shot methods use visual foundation models to match image regions to CAD models.<n>We introduce SUFLECA, a weakly-supervised framework for zero-shot CAD alignment.
  arXiv  Detail & Related papers  (2026-07-16T14:32:34Z)
• DreamCAD: Scaling Multi-modal CAD Generation using Differentiable Parametric Surfaces [67.45867367326105]
  We propose DreamCAD, a multi-modal generative framework that directly produces editable BReps from point-level supervision.<n>DreamCAD represents each BRep as a set of parametric patches and uses a differentiable tessellation method to generate meshes.<n>DreamCAD achieves state-of-the-art performance on ABC and averse benchmarks across text, image, and point modalities.
  arXiv  Detail & Related papers  (2026-03-05T19:04:07Z)
• BrepGaussian: CAD reconstruction from Multi-View Images with Gaussian Splatting [21.289489202626534]
  Boundary representation (B-rep) models a 3D solid as its explicit boundaries.<n>Recent advances in deep learning have greatly improved the recovery of 3D shape geometry.<n>We propose B-rep Splatting, a novel framework that learns 3D parametric representations from 2D images.
  arXiv  Detail & Related papers  (2026-02-24T17:03:45Z)
• BrepGPT: Autoregressive B-rep Generation with Voronoi Half-Patch [61.20046418942948]
  Boundary representation (B-rep) is the de facto standard for CAD model representation in modern industrial design.<n>We present BrepGPT, a single-stage autoregressive framework for B-rep generation.
  arXiv  Detail & Related papers  (2025-11-27T07:16:53Z)
• CMT: A Cascade MAR with Topology Predictor for Multimodal Conditional CAD Generation [59.76687657887415]
  We propose a cascade MAR with topology predictor (CMT), the first multimodal framework for CAD generation based on Boundary Representation (B-Rep)<n>Specifically, the cascade MAR can effectively capture the edge-counters-surface'' priors that are essential in B-Reps.<n>We develop a large-scale multimodal CAD dataset, mmABC, which includes over 1.3 million B-Rep models with multimodal annotations.
  arXiv  Detail & Related papers  (2025-04-29T14:52:28Z)
• HoLa: B-Rep Generation using a Holistic Latent Representation [51.07878285790399]
  We introduce a novel representation for learning and generating Computer-Aided Design (CAD) models in the form of $textitboundary representations$ (B-Reps)<n>Our representation unifies the continuous geometric properties of B-Rep primitives in different orders.<n>Our method significantly reduces ambiguities, redundancies, and incoherences among the generated B-Rep primitives.
  arXiv  Detail & Related papers  (2025-04-19T10:34:24Z)
• Constraint-Aware Feature Learning for Parametric Point Cloud [19.190053031718417]
  Parametric point clouds are sampled from CAD shapes and are becoming increasingly common in industrial manufacturing.<n>Most CAD-specific deep learning methods focus on geometric features, while overlooking constraints inherent in CAD shapes.<n>We introduce a deep learning-friendly constraints representation with three components, and design a constraint-aware feature learning network (CstNet)<n>CstNet is the first constraint-aware deep learning method tailored for parametric point cloud analysis.
  arXiv  Detail & Related papers  (2024-11-12T12:18:18Z)
• Split-and-Fit: Learning B-Reps via Structure-Aware Voronoi Partitioning [50.684254969269546]
  We introduce a novel method for acquiring boundary representations (B-Reps) of 3D CAD models. We apply a spatial partitioning to derive a single primitive within each partition. We show that our network, coined NVD-Net for neural Voronoi diagrams, can effectively learn Voronoi partitions for CAD models from training data.
  arXiv  Detail & Related papers  (2024-06-07T21:07:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.