HiT: History-Injection Transformers for Onboard Continuous Flood Change Detection

• URL: http://arxiv.org/abs/2601.13751v2
• Date: Wed, 21 Jan 2026 07:02:55 GMT
• Title: HiT: History-Injection Transformers for Onboard Continuous Flood Change Detection
• Authors: Daniel Kyselica, Jonáš Herec, Oliver Kutis, Rado Pitoňák,
• Abstract summary: We develop an onboard change detection system that operates within the memory and computational limits of small satellites.<n>We propose History Injection mechanism for Transformer models (HiT), that maintains historical context from previous observations.<n>The proposed HiT-Prithvi model achieved 43 FPS on Jetson Orin Nano, a representative onboard hardware used in nanosats.
• Score: 1.1666234644810893
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Natural disaster monitoring through continuous satellite observation requires processing multi-temporal data under strict operational constraints. This paper addresses flood detection, a critical application for hazard management, by developing an onboard change detection system that operates within the memory and computational limits of small satellites. We propose History Injection mechanism for Transformer models (HiT), that maintains historical context from previous observations while reducing data storage by over 99\% of original image size. Moreover, testing on the STTORM-CD flood dataset confirms that the HiT mechanism within the Prithvi-tiny foundation model maintains detection accuracy compared to the bitemporal baseline. The proposed HiT-Prithvi model achieved 43 FPS on Jetson Orin Nano, a representative onboard hardware used in nanosats. This work establishes a practical framework for satellite-based continuous monitoring of natural disasters, supporting real-time hazard assessment without dependency on ground-based processing infrastructure. Architecture as well as model checkpoints is available at https://github.com/zaitra/HiT-change-detection

Related papers

• Knowledge-Embedded and Hypernetwork-Guided Few-Shot Substation Meter Defect Image Generation Method [0.0]
  Substation meters play a critical role in monitoring and ensuring the stable operation of power grids.<n>Their detection of cracks and other physical defects is often hampered by a severe scarcity of annotated samples.<n>We propose a novel framework that integrates Conditional Knowledge Embedding and Hypernetwork-Guided Control into a Stable Diffusion pipeline.
  arXiv  Detail & Related papers  (2026-01-14T07:21:57Z)
• ASTREA: Introducing Agentic Intelligence for Orbital Thermal Autonomy [51.56484100374058]
  ASTREA is the first agentic system executed on flight-heritage hardware for autonomous spacecraft operations.<n>We integrate a resource-constrained Large Language Model (LLM) agent with a reinforcement learning controller in an asynchronous architecture tailored for space-qualified platforms.
  arXiv  Detail & Related papers  (2025-09-16T08:52:13Z)
• Training-free AI for Earth Observation Change Detection using Physics Aware Neuromorphic Networks [1.4146420810689422]
  A major bottleneck is in the bandwidth-limited downlinking of the data from satellites to ground stations.<n>In this work we propose a Physics Aware Neuromorphic Network (PANN) to detect changes caused by natural disasters.<n>The PANN was benchmarked against a state-of-the-art AI model and achieved comparable or better results in each natural disaster category.
  arXiv  Detail & Related papers  (2025-06-04T08:45:41Z)
• ARCANE -- Early Detection of Interplanetary Coronal Mass Ejections [0.0]
  ARCANE is the first framework explicitly designed for early ICME detection in streaming solar wind data.<n>We find that our detection pipeline achieves an F1-Score of 0.37, with an average detection delay of 24.5% of the event's duration.
  arXiv  Detail & Related papers  (2025-05-14T13:17:45Z)
• Context-Aware Generative Models for Prediction of Aircraft Ground Tracks [0.004807514276707785]
  Trajectory prediction plays an important role in supporting the decision-making of Air Traffic Controllers. Traditional TP methods are deterministic and physics-based, with parameters calibrated using aircraft surveillance data harvested across the world. This work proposes a generative method for lateral TP, using probabilistic machine learning to model the effect of the unknown effect of pilot behaviour and ATCO intentions.
  arXiv  Detail & Related papers  (2023-09-26T14:20:09Z)
• Efficient Real-time Smoke Filtration with 3D LiDAR for Search and Rescue with Autonomous Heterogeneous Robotic Systems [56.838297900091426]
  Smoke and dust affect the performance of any mobile robotic platform due to their reliance on onboard perception systems. This paper proposes a novel modular computation filtration pipeline based on intensity and spatial information.
  arXiv  Detail & Related papers  (2023-08-14T16:48:57Z)
• Uncovering the Missing Pattern: Unified Framework Towards Trajectory Imputation and Prediction [60.60223171143206]
  Trajectory prediction is a crucial undertaking in understanding entity movement or human behavior from observed sequences. Current methods often assume that the observed sequences are complete while ignoring the potential for missing values. This paper presents a unified framework, the Graph-based Conditional Variational Recurrent Neural Network (GC-VRNN), which can perform trajectory imputation and prediction simultaneously.
  arXiv  Detail & Related papers  (2023-03-28T14:27:27Z)
• Ranking-Based Physics-Informed Line Failure Detection in Power Grids [66.0797334582536]
  Real-time and accurate detecting of potential line failures is the first step to mitigating the extreme weather impact and activating emergency controls. Power balance equations nonlinearity, increased uncertainty in generation during extreme events, and lack of grid observability compromise the efficiency of traditional data-driven failure detection methods. This paper proposes a Physics-InformEd Line failure Detector (FIELD) that leverages grid topology information to reduce sample and time complexities and improve localization accuracy.
  arXiv  Detail & Related papers  (2022-08-31T18:19:25Z)
• Unsupervised Change Detection of Extreme Events Using ML On-Board [3.1955314117075715]
  We introduce RaVAEn, a lightweight, unsupervised approach for change detection in satellite data based on Variational Auto-Encoders (VAEs) RaVAEn pre-processes the sampled data directly on the satellite and flags changed areas to shorten downlink, the response time. We verified the efficacy of our system on a dataset composed of time series of catastrophic events.
  arXiv  Detail & Related papers  (2021-11-04T16:45:15Z)
• DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly detection in air transportation [68.8204255655161]
  We propose a novel anomaly detection model called Discriminatory Auto-Encoder (DAE) It uses the baseline of a regular LSTM-based auto-encoder but with several decoders, each getting data of a specific flight phase. Results show that the DAE achieves better results in both accuracy and speed of detection.
  arXiv  Detail & Related papers  (2021-09-08T14:07:55Z)
• DETReg: Unsupervised Pretraining with Region Priors for Object Detection [103.93533951746612]
  DETReg is a new self-supervised method that pretrains the entire object detection network. During pretraining, DETReg predicts object localizations to match the localizations from an unsupervised region proposal generator. It simultaneously aligns the corresponding feature embeddings with embeddings from a self-supervised image encoder.
  arXiv  Detail & Related papers  (2021-06-08T17:39:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.