Orient Anything

• URL: http://arxiv.org/abs/2410.02101v1
• Date: Wed, 2 Oct 2024 23:46:45 GMT
• Title: Orient Anything
• Authors: Christopher Scarvelis, David Benhaim, Paul Zhang,
• Abstract summary: We introduce a two-stage orientation pipeline that achieves state of the art performance on up-axis estimation. Unlike previous work, we train and evaluate our method on all of Shapenet rather than a subset of classes.
• Score: 4.342241136871849
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Orientation estimation is a fundamental task in 3D shape analysis which consists of estimating a shape's orientation axes: its side-, up-, and front-axes. Using this data, one can rotate a shape into canonical orientation, where its orientation axes are aligned with the coordinate axes. Developing an orientation algorithm that reliably estimates complete orientations of general shapes remains an open problem. We introduce a two-stage orientation pipeline that achieves state of the art performance on up-axis estimation and further demonstrate its efficacy on full-orientation estimation, where one seeks all three orientation axes. Unlike previous work, we train and evaluate our method on all of Shapenet rather than a subset of classes. We motivate our engineering contributions by theory describing fundamental obstacles to orientation estimation for rotationally-symmetric shapes, and show how our method avoids these obstacles.

Related papers

• Full-range Head Pose Geometric Data Augmentations [2.8358100463599722]
  Many head pose estimation (HPE) methods promise the ability to create full-range datasets. These methods are only accurate within a range of head angles; exceeding this specific range led to significant inaccuracies. Here, we present methods that accurately infer the correct coordinate system and Euler angles in the correct axis-sequence.
  arXiv  Detail & Related papers  (2024-08-02T20:41:18Z)
• Neural Gradient Learning and Optimization for Oriented Point Normal Estimation [53.611206368815125]
  We propose a deep learning approach to learn gradient vectors with consistent orientation from 3D point clouds for normal estimation. We learn an angular distance field based on local plane geometry to refine the coarse gradient vectors. Our method efficiently conducts global gradient approximation while achieving better accuracy and ability generalization of local feature description.
  arXiv  Detail & Related papers  (2023-09-17T08:35:11Z)
• Category-Level 6D Object Pose Estimation with Flexible Vector-Based Rotation Representation [51.67545893892129]
  We propose a novel 3D graph convolution based pipeline for category-level 6D pose and size estimation from monocular RGB-D images. We first design an orientation-aware autoencoder with 3D graph convolution for latent feature learning. Then, to efficiently decode the rotation information from the latent feature, we design a novel flexible vector-based decomposable rotation representation.
  arXiv  Detail & Related papers  (2022-12-09T02:13:43Z)
• Deep Projective Rotation Estimation through Relative Supervision [31.05330535795121]
  Deep learning has offered a way to develop image-based orientation estimators. These estimators often require training on a large labeled dataset. We propose a new algorithm for selfsupervised orientation estimation.
  arXiv  Detail & Related papers  (2022-11-21T04:58:07Z)
• E-Graph: Minimal Solution for Rigid Rotation with Extensibility Graphs [61.552125054227595]
  A new minimal solution is proposed to solve relative rotation estimation between two images without overlapping areas. Based on E-Graph, the rotation estimation problem becomes simpler and more elegant. We embed our rotation estimation strategy into a complete camera tracking and mapping system which obtains 6-DoF camera poses and a dense 3D mesh model.
  arXiv  Detail & Related papers  (2022-07-20T16:11:48Z)
• 6D Rotation Representation For Unconstrained Head Pose Estimation [2.1485350418225244]
  We address the problem of ambiguous rotation labels by introducing the rotation matrix formalism for our ground truth data. This way, our method can learn the full rotation appearance which is contrary to previous approaches that restrict the pose prediction to a narrow-angle. Experiments on the public AFLW2000 and BIWI datasets demonstrate that our proposed method significantly outperforms other state-of-the-art methods by up to 20%.
  arXiv  Detail & Related papers  (2022-02-25T08:41:13Z)
• Adjoint Rigid Transform Network: Task-conditioned Alignment of 3D Shapes [86.2129580231191]
  Adjoint Rigid Transform (ART) Network is a neural module which can be integrated with a variety of 3D networks. ART learns to rotate input shapes to a learned canonical orientation, which is crucial for a lot of tasks. We will release our code and pre-trained models for further research.
  arXiv  Detail & Related papers  (2021-02-01T20:58:45Z)
• Amplifying the Anterior-Posterior Difference via Data Enhancement -- A More Robust Deep Monocular Orientation Estimation Solution [7.540176446791261]
  Existing deep-learning based monocular orientation estimation algorithms face the problem of confusion between the anterior and posterior parts of the objects. We propose a pretraining method which focuses on predicting the left/right semicircle in which the orientation of the object is located. Experiment results show that the proposed semicircle prediction enhances the accuracy of orientation estimation, and mitigates the problem stated above.
  arXiv  Detail & Related papers  (2020-12-21T15:36:13Z)
• Learning to Orient Surfaces by Self-supervised Spherical CNNs [15.554429755106332]
  Defining and reliably finding a canonical orientation for 3D surfaces is key to many Computer Vision and Robotics applications. We show the feasibility of learning a robust canonical orientation for surfaces represented as point clouds. Our method learns such feature maps from raw data by a self-supervised training procedure and robustly selects a rotation to transform the input point cloud into a learned canonical orientation.
  arXiv  Detail & Related papers  (2020-11-06T11:43:57Z)
• A Rotation-Invariant Framework for Deep Point Cloud Analysis [132.91915346157018]
  We introduce a new low-level purely rotation-invariant representation to replace common 3D Cartesian coordinates as the network inputs. Also, we present a network architecture to embed these representations into features, encoding local relations between points and their neighbors, and the global shape structure. We evaluate our method on multiple point cloud analysis tasks, including shape classification, part segmentation, and shape retrieval.
  arXiv  Detail & Related papers  (2020-03-16T14:04:45Z)
• From Planes to Corners: Multi-Purpose Primitive Detection in Unorganized 3D Point Clouds [59.98665358527686]
  We propose a new method for segmentation-free joint estimation of orthogonal planes. Such unified scene exploration allows for multitudes of applications such as semantic plane detection or local and global scan alignment. Our experiments demonstrate the validity of our approach in numerous scenarios from wall detection to 6D tracking.
  arXiv  Detail & Related papers  (2020-01-21T06:51:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.