Reaching the Edge of the Edge: Image Analysis in Space

• URL: http://arxiv.org/abs/2301.04954v2
• Date: Tue, 27 Jun 2023 14:30:23 GMT
• Title: Reaching the Edge of the Edge: Image Analysis in Space
• Authors: Robert Bayer (1), Julian Priest (1), P{\i}nar T\"oz\"un (1) ((1) IT University of Copenhagen)
• Abstract summary: Satellites have become more widely available due to the reduction in size and cost of their components. There has been an advent of smaller organizations having the ability to deploy satellites with a variety of data-intensive applications to run on them. One popular application is image analysis to detect, for example, land, ice, clouds, etc. for Earth observation. However, the resource-constrained nature of the devices deployed in satellites creates additional challenges for this resource-intensive application.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Satellites have become more widely available due to the reduction in size and cost of their components. As a result, there has been an advent of smaller organizations having the ability to deploy satellites with a variety of data-intensive applications to run on them. One popular application is image analysis to detect, for example, land, ice, clouds, etc. for Earth observation. However, the resource-constrained nature of the devices deployed in satellites creates additional challenges for this resource-intensive application. In this paper, we present our work and lessons-learned on building an Image Processing Unit (IPU) for a satellite. We first investigate the performance of a variety of edge devices (comparing CPU, GPU, TPU, and VPU) for deep-learning-based image processing on satellites. Our goal is to identify devices that can achieve accurate results and are flexible when workload changes while satisfying the power and latency constraints of satellites. Our results demonstrate that hardware accelerators such as ASICs and GPUs are essential for meeting the latency requirements. However, state-of-the-art edge devices with GPUs may draw too much power for deployment on a satellite. Then, we use the findings gained from the performance analysis to guide the development of the IPU module for an upcoming satellite mission. We detail how to integrate such a module into an existing satellite architecture and the software necessary to support various missions utilizing this module.

Related papers

• Vehicle Perception from Satellite [54.07157185000604]
  The dataset is constructed based on 12 satellite videos and 14 synthetic videos recorded from GTA-V. It supports several tasks, including tiny object detection, counting and density estimation. 128,801 vehicles are annotated totally, and the number of vehicles in each image varies from 0 to 101.
  arXiv  Detail & Related papers  (2024-02-01T15:59:16Z)
• Stitching Satellites to the Edge: Pervasive and Efficient Federated LEO Satellite Learning [1.3121410433987561]
  This paper proposes a novel FL-SEC framework that empowers satellites to execute large-scale machine learning (ML) tasks onboard efficiently. Key components include personalized learning via divide-and-conquer, which identifies and eliminates redundant satellite images, and orbital model retraining, which generates an aggregated "orbital model" per orbit and retrains it before sending to the ground station. Our approach dramatically reduces FL convergence time by nearly 30 times, and satellite energy consumption down to as low as 1.38 watts, all while maintaining an exceptional accuracy of up to 96%.
  arXiv  Detail & Related papers  (2024-01-28T02:01:26Z)
• Characterizing Satellite Geometry via Accelerated 3D Gaussian Splatting [0.0]
  We present an approach for mapping of satellites on orbit based on 3D Gaussian Splatting. We demonstrate model training and 3D rendering performance on a hardware-in-the-loop satellite mock-up. Our model is shown to be capable of training on-board and rendering higher quality novel views of an unknown satellite nearly 2 orders of magnitude faster than previous NeRF-based algorithms.
  arXiv  Detail & Related papers  (2024-01-05T00:49:56Z)
• FedSN: A Federated Learning Framework over Heterogeneous LEO Satellite Networks [18.213174641216884]
  A large number of Low Earth Orbit (LEO) satellites have been launched and deployed successfully in space by commercial companies, such as SpaceX. Due to multimodal sensors equipped by the LEO satellites, they serve not only for communication but also for various machine learning applications, such as space modulation recognition, remote sensing image classification, etc. We propose FedSN as a general FL framework to tackle the above challenges, and fully explore data diversity on LEO satellites.
  arXiv  Detail & Related papers  (2023-11-02T14:47:06Z)
• Diffusion Models for Interferometric Satellite Aperture Radar [73.01013149014865]
  Probabilistic Diffusion Models (PDMs) have recently emerged as a very promising class of generative models. Here, we leverage PDMs to generate several radar-based satellite image datasets. We show that PDMs succeed in generating images with complex and realistic structures, but that sampling time remains an issue.
  arXiv  Detail & Related papers  (2023-08-31T16:26:17Z)
• Satellite Image Time Series Analysis for Big Earth Observation Data [50.591267188664666]
  This paper describes sits, an open-source R package for satellite image time series analysis using machine learning. We show that this approach produces high accuracy for land use and land cover maps through a case study in the Cerrado biome.
  arXiv  Detail & Related papers  (2022-04-24T15:23:25Z)
• Deep Learning for Real Time Satellite Pose Estimation on Low Power Edge TPU [58.720142291102135]
  In this paper we propose a pose estimation software exploiting neural network architectures. We show how low power machine learning accelerators could enable Artificial Intelligence exploitation in space.
  arXiv  Detail & Related papers  (2022-04-07T08:53:18Z)
• ADAPT: An Open-Source sUAS Payload for Real-Time Disaster Prediction and Response with AI [55.41644538483948]
  Small unmanned aircraft systems (sUAS) are becoming prominent components of many humanitarian assistance and disaster response operations. We have developed the free and open-source ADAPT multi-mission payload for deploying real-time AI and computer vision onboard a sUAS. We demonstrate the example mission of real-time, in-flight ice segmentation to monitor river ice state and provide timely predictions of catastrophic flooding events.
  arXiv  Detail & Related papers  (2022-01-25T14:51:19Z)
• Autonomous Aerial Robot for High-Speed Search and Intercept Applications [86.72321289033562]
  A fully-autonomous aerial robot for high-speed object grasping has been proposed. As an additional sub-task, our system is able to autonomously pierce balloons located in poles close to the surface. Our approach has been validated in a challenging international competition and has shown outstanding results.
  arXiv  Detail & Related papers  (2021-12-10T11:49:51Z)
• Edge Detection for Satellite Images without Deep Networks [2.741266294612776]
  Recent approaches to satellite image analysis have largely emphasized deep learning methods. Deep learning has some drawbacks, including the requirement of specialized computing hardware. The cost of both computational resources and training data annotation may be prohibitive when dealing with large satellite datasets.
  arXiv  Detail & Related papers  (2021-05-26T15:47:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.