A Satellite-Ground Synergistic Large Vision-Language Model System for Earth Observation

• URL: http://arxiv.org/abs/2507.05731v1
• Date: Tue, 08 Jul 2025 07:24:34 GMT
• Title: A Satellite-Ground Synergistic Large Vision-Language Model System for Earth Observation
• Authors: Yuxin Zhang, Jiahao Yang, Zhe Chen, Wenjun Zhu, Jin Zhao, Yue Gao,
• Abstract summary: Large vision-language models (LVLMs) unleash powerful analysis capabilities for low Earth orbit (LEO) satellite Earth observation images in the data center.<n>Fast satellite motion, brief satellite-ground station (GS) contact windows, and large size of the images pose a data download challenge.<n>We explore how to deploy LVLM in LEO satellite networks, and design SpaceVerse, an efficient satellite-ground synergistic LVLM inference system.
• Score: 17.112498759423296
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, large vision-language models (LVLMs) unleash powerful analysis capabilities for low Earth orbit (LEO) satellite Earth observation images in the data center. However, fast satellite motion, brief satellite-ground station (GS) contact windows, and large size of the images pose a data download challenge. To enable near real-time Earth observation applications (e.g., disaster and extreme weather monitoring), we should explore how to deploy LVLM in LEO satellite networks, and design SpaceVerse, an efficient satellite-ground synergistic LVLM inference system. To this end, firstly, we deploy compact LVLMs on satellites for lightweight tasks, whereas regular LVLMs operate on GSs to handle computationally intensive tasks. Then, we propose a computing and communication co-design framework comprised of a progressive confidence network and an attention-based multi-scale preprocessing, used to identify on-satellite inferring data, and reduce data redundancy before satellite-GS transmission, separately. We implement and evaluate SpaceVerse on real-world LEO satellite constellations and datasets, achieving a 31.2% average gain in accuracy and a 51.2% reduction in latency compared to state-of-the-art baselines.

Related papers

• A Semi-Supervised Federated Learning Framework with Hierarchical Clustering Aggregation for Heterogeneous Satellite Networks [2.5774044809669663]
  Low Earth Orbit (LEO) satellites are emerging as key components of 6G networks.<n>We propose a novel semi-supervised federated learning framework tailored for LEO satellite networks with hierarchical aggregation.<n>Our proposal can significantly reduce processing time (up to 3x) and energy consumption (up to 4x) compared to other comparative methods.
  arXiv  Detail & Related papers  (2025-07-30T02:47:14Z)
• Constellation as a Service: Tailored Connectivity Management in Direct-Satellite-to-Device Networks [51.982277327318656]
  Direct-satellite-to-device (DS2D) communication is emerging as a promising solution for global mobile service extension.<n>The challenge of managing DS2D connectivity for multi-constellations becomes outstanding.<n>This article proposes a Constellation as a Service framework, which treats the entire multi-constellation infrastructure as a shared resource pool.
  arXiv  Detail & Related papers  (2025-07-01T16:06:29Z)
• Low-altitude Friendly-Jamming for Satellite-Maritime Communications via Generative AI-enabled Deep Reinforcement Learning [72.72954660774002]
  Low Earth Orbit (LEO) satellites can be used to assist maritime wireless communications for data transmission across wide-ranging areas.<n>Extensive coverage of LEO satellites, combined with openness of channels, can cause the communication process to suffer from security risks.<n>This paper presents a low-altitude friendly-jamming LEO satellite-maritime communication system enabled by a unmanned aerial vehicle.
  arXiv  Detail & Related papers  (2025-01-26T10:13:51Z)
• Reconstructing Satellites in 3D from Amateur Telescope Images [44.20773507571372]
  We propose a novel computational imaging framework that overcomes obstacles by integrating a hybrid image pre-processing pipeline.<n>We validate our approach on both synthetic satellite datasets and on-sky observations of China's Tiangong Space Station and the International Space Station.<n>Our framework enables high-fidelity 3D satellite monitoring from Earth, offering a cost-effective alternative for space situational awareness.
  arXiv  Detail & Related papers  (2024-04-29T03:13:09Z)
• Vehicle Perception from Satellite [54.07157185000604]
  The dataset is constructed based on 12 satellite videos and 14 synthetic videos recorded from GTA-V. It supports several tasks, including tiny object detection, counting and density estimation. 128,801 vehicles are annotated totally, and the number of vehicles in each image varies from 0 to 101.
  arXiv  Detail & Related papers  (2024-02-01T15:59:16Z)
• Stitching Satellites to the Edge: Pervasive and Efficient Federated LEO Satellite Learning [1.3121410433987561]
  This paper proposes a novel FL-SEC framework that empowers satellites to execute large-scale machine learning (ML) tasks onboard efficiently. Key components include personalized learning via divide-and-conquer, which identifies and eliminates redundant satellite images, and orbital model retraining, which generates an aggregated "orbital model" per orbit and retrains it before sending to the ground station. Our approach dramatically reduces FL convergence time by nearly 30 times, and satellite energy consumption down to as low as 1.38 watts, all while maintaining an exceptional accuracy of up to 96%.
  arXiv  Detail & Related papers  (2024-01-28T02:01:26Z)
• FedSN: A Federated Learning Framework over Heterogeneous LEO Satellite Networks [18.213174641216884]
  A large number of Low Earth Orbit (LEO) satellites have been launched and deployed successfully in space by commercial companies, such as SpaceX. Due to multimodal sensors equipped by the LEO satellites, they serve not only for communication but also for various machine learning applications, such as space modulation recognition, remote sensing image classification, etc. We propose FedSN as a general FL framework to tackle the above challenges, and fully explore data diversity on LEO satellites.
  arXiv  Detail & Related papers  (2023-11-02T14:47:06Z)
• Secure and Efficient Federated Learning in LEO Constellations using Decentralized Key Generation and On-Orbit Model Aggregation [1.4952056744888915]
  This paper proposes FedSecure, a secure FL approach designed for LEO constellations. FedSecure preserves the privacy of each satellite's data against eavesdroppers, a curious server, or curious satellites. It also reduces convergence delay drastically from days to only a few hours, yet achieving high accuracy of up to 85.35%.
  arXiv  Detail & Related papers  (2023-09-04T21:36:46Z)
• Optimizing Federated Learning in LEO Satellite Constellations via Intra-Plane Model Propagation and Sink Satellite Scheduling [3.096615629099617]
  Satellite edge computing (SEC) allows each satellite to train an ML model onboard and uploads only the model to the ground station. This paper proposes FedLEO, a novel federated learning (FL) framework that overcomes the limitation (slow convergence) of existing FL-based solutions. Our results show that FedLEO drastically expedites FL convergence, without sacrificing -- in fact it considerably increases -- the model accuracy.
  arXiv  Detail & Related papers  (2023-02-27T00:32:01Z)
• Deep Learning Aided Routing for Space-Air-Ground Integrated Networks Relying on Real Satellite, Flight, and Shipping Data [79.96177511319713]
  Current maritime communications mainly rely on satellites having meager transmission resources, hence suffering from poorer performance than modern terrestrial wireless networks. With the growth of transcontinental air traffic, the promising concept of aeronautical ad hoc networking relying on commercial passenger airplanes is potentially capable of enhancing satellite-based maritime communications via air-to-ground and multi-hop air-to-air links. We propose space-air-ground integrated networks (SAGINs) for supporting ubiquitous maritime communications, where the low-earth-orbit satellite constellations, passenger airplanes, terrestrial base stations, ships, respectively, serve as the space-, air-,
  arXiv  Detail & Related papers  (2021-10-28T14:12:10Z)
• Integrating LEO Satellite and UAV Relaying via Reinforcement Learning for Non-Terrestrial Networks [51.05735925326235]
  A mega-constellation of low-earth orbit (LEO) satellites has the potential to enable long-range communication with low latency. We study the problem of forwarding packets between two faraway ground terminals, through an LEO satellite selected from an orbiting constellation. To maximize the end-to-end data rate, the satellite association and HAP location should be optimized. We tackle this problem using deep reinforcement learning (DRL) with a novel action dimension reduction technique.
  arXiv  Detail & Related papers  (2020-05-26T05:39:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.