Iterative Motion Compensation for Canonical 3D Reconstruction from UAV Plant Images Captured in Windy Conditions

• URL: http://arxiv.org/abs/2510.15491v1
• Date: Fri, 17 Oct 2025 10:04:08 GMT
• Title: Iterative Motion Compensation for Canonical 3D Reconstruction from UAV Plant Images Captured in Windy Conditions
• Abstract summary: 3D phenotyping of plants plays a crucial role for understanding plant growth, yield prediction, and disease control.<n>We present a pipeline capable of generating high-quality 3D reconstructions of individual agricultural plants.
• Score: 15.401929638574268
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: 3D phenotyping of plants plays a crucial role for understanding plant growth, yield prediction, and disease control. We present a pipeline capable of generating high-quality 3D reconstructions of individual agricultural plants. To acquire data, a small commercially available UAV captures images of a selected plant. Apart from placing ArUco markers, the entire image acquisition process is fully autonomous, controlled by a self-developed Android application running on the drone's controller. The reconstruction task is particularly challenging due to environmental wind and downwash of the UAV. Our proposed pipeline supports the integration of arbitrary state-of-the-art 3D reconstruction methods. To mitigate errors caused by leaf motion during image capture, we use an iterative method that gradually adjusts the input images through deformation. Motion is estimated using optical flow between the original input images and intermediate 3D reconstructions rendered from the corresponding viewpoints. This alignment gradually reduces scene motion, resulting in a canonical representation. After a few iterations, our pipeline improves the reconstruction of state-of-the-art methods and enables the extraction of high-resolution 3D meshes. We will publicly release the source code of our reconstruction pipeline. Additionally, we provide a dataset consisting of multiple plants from various crops, captured across different points in time.

Related papers

• On-the-Fly3R: Towards Robust Online 3D Reconstruction with Feed-Forward 3R Models for Large-Scale UAV Scenarios [6.729903292561442]
  On-the-Fly3R is a training-free, progressive online 3D reconstruction framework for large-scale UAV images.<n>Our method enables reconstruction from unordered inputs via retrieval-guided dynamic subset construction.<n>Our method successfully scales various 3R models to over 5,000 images across square-kilometer UAV scenes.
  arXiv  Detail & Related papers  (2026-09-01T08:47:58Z)
• Visual Geometry Transformer in the Wild: Distractor-Free 3D Reconstruction [77.75911117889915]
  Current end-to-end multi-view 3D reconstruction methods achieve impressive results, but rely on a restrictive static assumption.<n>This reliance on idealized inputs causes even the most advanced methods to fail in real-world settings.<n>We propose Visual Geometry Transformer in the Wild, an end-to-end framework for robust reconstruction from inconsistent views.
  arXiv  Detail & Related papers  (2026-06-22T02:52:22Z)
• Object-Centric 3D Gaussian Splatting for Strawberry Plant Reconstruction and Phenotyping [21.752518657362888]
  Strawberries are among the most economically significant fruits in the United States, generating over $2 billion in annual farm-gate sales.<n>Traditional plant phenotyping methods are time-consuming, labor-intensive, and often destructive.<n>We propose a novel object-centric 3D reconstruction framework incorporating a preprocessing pipeline.
  arXiv  Detail & Related papers  (2025-11-04T02:55:46Z)
• UAV4D: Dynamic Neural Rendering of Human-Centric UAV Imagery using Gaussian Splatting [54.883935964137706]
  We introduce UAV4D, a framework for enabling photorealistic rendering for dynamic real-world scenes captured by UAVs.<n>We use a combination of a 3D foundation model and a human mesh reconstruction model to reconstruct both the scene background and humans.<n>Our results demonstrate the benefits of our approach over existing methods in novel view synthesis, achieving a 1.5 dB PSNR improvement and superior visual sharpness.
  arXiv  Detail & Related papers  (2025-06-05T13:21:09Z)
• ACT-R: Adaptive Camera Trajectories for Single View 3D Reconstruction [12.942796503696194]
  We introduce the simple idea of adaptive view planning to multi-view synthesis.<n>We generate a sequence of views, leveraging temporal consistency to enhance 3D coherence.<n>Our method improves 3D reconstruction over SOTA alternatives on the unseen GSO dataset.
  arXiv  Detail & Related papers  (2025-05-13T05:31:59Z)
• HORT: Monocular Hand-held Objects Reconstruction with Transformers [61.36376511119355]
  Reconstructing hand-held objects in 3D from monocular images is a significant challenge in computer vision.<n>We propose a transformer-based model to efficiently reconstruct dense 3D point clouds of hand-held objects.<n>Our method achieves state-of-the-art accuracy with much faster inference speed, while generalizing well to in-the-wild images.
  arXiv  Detail & Related papers  (2025-03-27T09:45:09Z)
• CropCraft: Inverse Procedural Modeling for 3D Reconstruction of Crop Plants [16.558411700996746]
  We present a novel method for 3D reconstruction of agricultural crops based on optimizing a model of plant morphology via inverse procedural modeling. We validate our method on a dataset of real images of agricultural fields, and demonstrate that the reconstructions can be used for a variety of monitoring and simulation applications.
  arXiv  Detail & Related papers  (2024-11-14T18:58:02Z)
• LucidFusion: Reconstructing 3D Gaussians with Arbitrary Unposed Images [23.96972213606037]
  We reformulate 3D reconstruction as image-to-image translation and introduce the Relative Coordinate Map (RCM)<n>RCM aligns multiple unposed images to a main view without pose estimation.<n>While RCM simplifies the process, its lack of global 3D supervision can yield noisy outputs.<n>Our LucidFusion framework handles an arbitrary number of unposed inputs, producing robust 3D reconstructions within seconds and paving the way for more flexible, pose-free 3D pipelines.
  arXiv  Detail & Related papers  (2024-10-21T04:47:01Z)
• Frequency-based View Selection in Gaussian Splatting Reconstruction [9.603843571051744]
  We investigate the problem of active view selection to perform 3D Gaussian Splatting reconstructions with as few input images as possible. By ranking the potential views in the frequency domain, we are able to effectively estimate the potential information gain of new viewpoints. Our method achieves state-of-the-art results in view selection, demonstrating its potential for efficient image-based 3D reconstruction.
  arXiv  Detail & Related papers  (2024-09-24T21:44:26Z)
• MaRINeR: Enhancing Novel Views by Matching Rendered Images with Nearby References [49.71130133080821]
  MaRINeR is a refinement method that leverages information of a nearby mapping image to improve the rendering of a target viewpoint. We show improved renderings in quantitative metrics and qualitative examples from both explicit and implicit scene representations.
  arXiv  Detail & Related papers  (2024-07-18T17:50:03Z)
• Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusion [67.71624118802411]
  We present Farm3D, a method for learning category-specific 3D reconstructors for articulated objects. We propose a framework that uses an image generator, such as Stable Diffusion, to generate synthetic training data. Our network can be used for analysis, including monocular reconstruction, or for synthesis, generating articulated assets for real-time applications such as video games.
  arXiv  Detail & Related papers  (2023-04-20T17:59:34Z)
• High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimization [51.878078860524795]
  We present a high-fidelity 3D generative adversarial network (GAN) inversion framework that can synthesize photo-realistic novel views. Our approach enables high-fidelity 3D rendering from a single image, which is promising for various applications of AI-generated 3D content.
  arXiv  Detail & Related papers  (2022-11-28T18:59:52Z)
• Pix2Vox++: Multi-scale Context-aware 3D Object Reconstruction from Single and Multiple Images [56.652027072552606]
  We propose a novel framework for single-view and multi-view 3D object reconstruction, named Pix2Vox++. By using a well-designed encoder-decoder, it generates a coarse 3D volume from each input image. A multi-scale context-aware fusion module is then introduced to adaptively select high-quality reconstructions for different parts from all coarse 3D volumes to obtain a fused 3D volume.
  arXiv  Detail & Related papers  (2020-06-22T13:48:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.