Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing

• URL: http://arxiv.org/abs/2209.11945v1
• Date: Sat, 24 Sep 2022 07:22:09 GMT
• Title: Towards Bridging the Space Domain Gap for Satellite Pose Estimation using Event Sensing
• Authors: Mohsi Jawaid, Ethan Elms, Yasir Latif and Tat-Jun Chin
• Abstract summary: Event sensing offers a promising solution to generalise from the simulation to the target domain under stark illumination differences. Our main contribution is an event-based satellite pose estimation technique, trained purely on synthetic data. Results on the dataset showed that our event-based satellite pose estimation method, trained only on synthetic data without adaptation, could generalise to the target domain effectively.
• Score: 35.467052373502575
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Deep models trained using synthetic data require domain adaptation to bridge the gap between the simulation and target environments. State-of-the-art domain adaptation methods often demand sufficient amounts of (unlabelled) data from the target domain. However, this need is difficult to fulfil when the target domain is an extreme environment, such as space. In this paper, our target problem is close proximity satellite pose estimation, where it is costly to obtain images of satellites from actual rendezvous missions. We demonstrate that event sensing offers a promising solution to generalise from the simulation to the target domain under stark illumination differences. Our main contribution is an event-based satellite pose estimation technique, trained purely on synthetic event data with basic data augmentation to improve robustness against practical (noisy) event sensors. Underpinning our method is a novel dataset with carefully calibrated ground truth, comprising of real event data obtained by emulating satellite rendezvous scenarios in the lab under drastic lighting conditions. Results on the dataset showed that our event-based satellite pose estimation method, trained only on synthetic data without adaptation, could generalise to the target domain effectively.

Related papers

• Test-Time Certifiable Self-Supervision to Bridge the Sim2Real Gap in Event-Based Satellite Pose Estimation [39.53065184075108]
  A major cause of the Sim2Real gap are novel lighting conditions encountered during test time. The paper proposes a test-time self-supervision scheme with a certifier module.
  arXiv  Detail & Related papers  (2024-09-10T06:17:07Z)
• Vision-Based Detection of Uncooperative Targets and Components on Small Satellites [6.999319023465766]
  Space debris and inactive satellites pose a threat to the safety and integrity of operational spacecraft. Recent advancements in computer vision models can be used to improve upon existing methods for tracking such uncooperative targets. This paper introduces an autonomous detection model designed to identify and monitor these objects using learning and computer vision.
  arXiv  Detail & Related papers  (2024-08-22T02:48:13Z)
• SPADES: A Realistic Spacecraft Pose Estimation Dataset using Event Sensing [9.583223655096077]
  Due to limited access to real target datasets, algorithms are often trained using synthetic data and applied in the real domain. Event sensing has been explored in the past and shown to reduce the domain gap between simulations and real-world scenarios. We introduce a novel dataset, SPADES, comprising real event data acquired in a controlled laboratory environment and simulated event data using the same camera intrinsics.
  arXiv  Detail & Related papers  (2023-11-09T12:14:47Z)
• On the Generation of a Synthetic Event-Based Vision Dataset for Navigation and Landing [69.34740063574921]
  This paper presents a methodology for generating event-based vision datasets from optimal landing trajectories. We construct sequences of photorealistic images of the lunar surface with the Planet and Asteroid Natural Scene Generation Utility. We demonstrate that the pipeline can generate realistic event-based representations of surface features by constructing a dataset of 500 trajectories.
  arXiv  Detail & Related papers  (2023-08-01T09:14:20Z)
• Synthetic-to-Real Domain Adaptation for Action Recognition: A Dataset and Baseline Performances [76.34037366117234]
  We introduce a new dataset called Robot Control Gestures (RoCoG-v2) The dataset is composed of both real and synthetic videos from seven gesture classes. We present results using state-of-the-art action recognition and domain adaptation algorithms.
  arXiv  Detail & Related papers  (2023-03-17T23:23:55Z)
• One-Shot Domain Adaptive and Generalizable Semantic Segmentation with Class-Aware Cross-Domain Transformers [96.51828911883456]
  Unsupervised sim-to-real domain adaptation (UDA) for semantic segmentation aims to improve the real-world test performance of a model trained on simulated data. Traditional UDA often assumes that there are abundant unlabeled real-world data samples available during training for the adaptation. We explore the one-shot unsupervised sim-to-real domain adaptation (OSUDA) and generalization problem, where only one real-world data sample is available.
  arXiv  Detail & Related papers  (2022-12-14T15:54:15Z)
• Embedding Earth: Self-supervised contrastive pre-training for dense land cover classification [61.44538721707377]
  We present Embedding Earth a self-supervised contrastive pre-training method for leveraging the large availability of satellite imagery. We observe significant improvements up to 25% absolute mIoU when pre-trained with our proposed method. We find that learnt features can generalize between disparate regions opening up the possibility of using the proposed pre-training scheme.
  arXiv  Detail & Related papers  (2022-03-11T16:14:14Z)
• SPARK: SPAcecraft Recognition leveraging Knowledge of Space Environment [10.068428438297563]
  This paper proposes the SPARK dataset as a new unique space object multi-modal image dataset. The SPARK dataset has been generated under a realistic space simulation environment. It provides about 150k images per modality, RGB and depth, and 11 classes for spacecrafts and debris.
  arXiv  Detail & Related papers  (2021-04-13T07:16:55Z)
• Domain Adaptation with Incomplete Target Domains [61.68950959231601]
  We propose an Incomplete Data Imputation based Adversarial Network (IDIAN) model to address this new domain adaptation challenge. In the proposed model, we design a data imputation module to fill the missing feature values based on the partial observations in the target domain. We conduct experiments on both cross-domain benchmark tasks and a real world adaptation task with imperfect target domains.
  arXiv  Detail & Related papers  (2020-12-03T00:07:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.