CNN-Based Camera Pose Estimation and Localisation of Scan Images for Aircraft Visual Inspection

• URL: http://arxiv.org/abs/2511.18702v1
• Date: Mon, 24 Nov 2025 02:52:36 GMT
• Title: CNN-Based Camera Pose Estimation and Localisation of Scan Images for Aircraft Visual Inspection
• Authors: Xueyan Oh, Leonard Loh, Shaohui Foong, Zhong Bao Andy Koh, Kow Leong Ng, Poh Kang Tan, Pei Lin Pearlin Toh, U-Xuan Tan,
• Abstract summary: General Visual Inspection is a manual process used to detect and localise obvious damage on the exterior of commercial aircraft.<n>This paper proposes an on-site method that is infrastructure-free and easy to deploy for estimating a pan-tilt-zoom camera's pose and localising scan images.
• Score: 7.714454436505029
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: General Visual Inspection is a manual inspection process regularly used to detect and localise obvious damage on the exterior of commercial aircraft. There has been increasing demand to perform this process at the boarding gate to minimise the downtime of the aircraft and automating this process is desired to reduce the reliance on human labour. Automating this typically requires estimating a camera's pose with respect to the aircraft for initialisation but most existing localisation methods require infrastructure, which is very challenging in uncontrolled outdoor environments and within the limited turnover time (approximately 2 hours) on an airport tarmac. Additionally, many airlines and airports do not allow contact with the aircraft's surface or using UAVs for inspection between flights, and restrict access to commercial aircraft. Hence, this paper proposes an on-site method that is infrastructure-free and easy to deploy for estimating a pan-tilt-zoom camera's pose and localising scan images. This method initialises using the same pan-tilt-zoom camera used for the inspection task by utilising a Deep Convolutional Neural Network fine-tuned on only synthetic images to predict its own pose. We apply domain randomisation to generate the dataset for fine-tuning the network and modify its loss function by leveraging aircraft geometry to improve accuracy. We also propose a workflow for initialisation, scan path planning, and precise localisation of images captured from a pan-tilt-zoom camera. We evaluate and demonstrate our approach through experiments with real aircraft, achieving root-mean-square camera pose estimation errors of less than 0.24 m and 2 degrees for all real scenes.

Related papers

• FlyPose: Towards Robust Human Pose Estimation From Aerial Views [0.0]
  We train and deploy FlyPose, a lightweight top-down human pose estimation pipeline for aerial imagery.<n>We achieve an average improvement of 6.8 mAP in person detection across the test-sets of Manipal-UAV, VisDrone, HIT-UAV and our custom dataset.<n>FlyPose runs with an inference latency of 20 milliseconds including preprocessing on a Jetson Orin AGX Developer Kit.
  arXiv  Detail & Related papers  (2026-01-09T12:01:36Z)
• Loc$^2$: Interpretable Cross-View Localization via Depth-Lifted Local Feature Matching [80.57282092735991]
  We propose an accurate and interpretable fine-grained cross-view localization method.<n>It estimates the 3 Degrees of Freedom (DoF) pose of a ground-level image by matching its local features with a reference aerial image.<n> Experiments show state-of-the-art accuracy in challenging scenarios such as cross-area testing and unknown orientation.
  arXiv  Detail & Related papers  (2025-09-11T18:52:16Z)
• Accurate Pose Estimation for Flight Platforms based on Divergent Multi-Aperture Imaging System [8.98211713131741]
  Vision-based pose estimation plays a crucial role in the autonomous navigation of flight platforms.<n>Field of view and spatial resolution of the camera limit pose estimation accuracy.<n>This paper designs a divergent multi-aperture imaging system to achieve simultaneous observation of a large field of view and high spatial resolution.
  arXiv  Detail & Related papers  (2025-02-27T02:51:09Z)
• CamLoPA: A Hidden Wireless Camera Localization Framework via Signal Propagation Path Analysis [59.86280992504629]
  CamLoPA is a training-free wireless camera detection and localization framework. It operates with minimal activity space constraints using low-cost commercial-off-the-shelf (COTS) devices. It achieves 95.37% snooping camera detection accuracy and an average localization error of 17.23, under the significantly reduced activity space requirements.
  arXiv  Detail & Related papers  (2024-09-23T16:23:50Z)
• Vision-Language Modeling with Regularized Spatial Transformer Networks for All Weather Crosswind Landing of Aircraft [0.3749861135832073]
  A vision-based system trained to clear weather-induced visual degradations requires a robust landing dataset under various climatic conditions. We propose to synthesize harsh weather landing images by training a prompt-based climatic diffusion network. Also, we optimize a weather distillation model using a novel diffusion-distillation loss to learn to clear these visual degradations.
  arXiv  Detail & Related papers  (2024-05-09T06:48:42Z)
• ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Rendering [83.75284107397003]
  We introduce ScatterNeRF, a neural rendering method which renders scenes and decomposes the fog-free background. We propose a disentangled representation for the scattering volume and the scene objects, and learn the scene reconstruction with physics-inspired losses. We validate our method by capturing multi-view In-the-Wild data and controlled captures in a large-scale fog chamber.
  arXiv  Detail & Related papers  (2023-05-03T13:24:06Z)
• Extrinsic Camera Calibration with Semantic Segmentation [60.330549990863624]
  We present an extrinsic camera calibration approach that automatizes the parameter estimation by utilizing semantic segmentation information. Our approach relies on a coarse initial measurement of the camera pose and builds on lidar sensors mounted on a vehicle. We evaluate our method on simulated and real-world data to demonstrate low error measurements in the calibration results.
  arXiv  Detail & Related papers  (2022-08-08T07:25:03Z)
• Cross-Camera Trajectories Help Person Retrieval in a Camera Network [124.65912458467643]
  Existing methods often rely on purely visual matching or consider temporal constraints but ignore the spatial information of the camera network. We propose a pedestrian retrieval framework based on cross-camera generation, which integrates both temporal and spatial information. To verify the effectiveness of our method, we construct the first cross-camera pedestrian trajectory dataset.
  arXiv  Detail & Related papers  (2022-04-27T13:10:48Z)
• Rethinking Drone-Based Search and Rescue with Aerial Person Detection [79.76669658740902]
  The visual inspection of aerial drone footage is an integral part of land search and rescue (SAR) operations today. We propose a novel deep learning algorithm to automate this aerial person detection (APD) task. We present the novel Aerial Inspection RetinaNet (AIR) algorithm as the combination of these contributions.
  arXiv  Detail & Related papers  (2021-11-17T21:48:31Z)
• Real-time Geo-localization Using Satellite Imagery and Topography for Unmanned Aerial Vehicles [18.71806336611299]
  We propose a framework that is reliable in changing scenes and pragmatic for lightweight embedded systems on UAVs. The framework is comprised of two stages: offline database preparation and online inference. We present field experiments of image-based localization on two different UAV platforms to validate our results.
  arXiv  Detail & Related papers  (2021-08-07T01:47:19Z)
• Perceiving Traffic from Aerial Images [86.994032967469]
  We propose an object detection method called Butterfly Detector that is tailored to detect objects in aerial images. We evaluate our Butterfly Detector on two publicly available UAV datasets (UAVDT and VisDrone 2019) and show that it outperforms previous state-of-the-art methods while remaining real-time.
  arXiv  Detail & Related papers  (2020-09-16T11:37:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.