Adaptive and Robust Image Processing on CubeSats
- URL: http://arxiv.org/abs/2506.03152v1
- Date: Fri, 16 May 2025 16:03:04 GMT
- Title: Adaptive and Robust Image Processing on CubeSats
- Abstract summary: CubeSats offer a low-cost platform for space research, particularly for Earth observation.<n>This paper introduces two novel systems, DIPP and DISH, to address these challenges.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: CubeSats offer a low-cost platform for space research, particularly for Earth observation. However, their resource-constrained nature and being in space, challenge the flexibility and complexity of the deployed image processing pipelines and their orchestration. This paper introduces two novel systems, DIPP and DISH, to address these challenges. DIPP is a modular and configurable image processing pipeline framework that allows for adaptability to changing mission goals even after deployment, while preserving robustness. DISH is a domain-specific language (DSL) and runtime system designed to schedule complex imaging workloads on low-power and memory-constrained processors. Our experiments demonstrate that DIPP's decomposition of the processing pipelines adds negligible overhead, while significantly reducing the network requirements of updating pipelines and being robust against erroneous module uploads. Furthermore, we compare DISH to Lua, a general purpose scripting language, and demonstrate its comparable expressiveness and lower memory requirement.
Related papers
- Decoupled I/O-Dominant Pipelines for Large-Scale Whole-Slide Image Embedding Extraction [12.996943804893661]
Whole-slide images (WSIs) are central to computational pathology but are prohibitively large, making patch-based processing the practical unit for foundation model inference.<n>We present a decoupled, I/O-aware pipeline for large-scale WSI embedding extraction that decomposes the workflow into three stages.<n>This design isolates data movement from compute, enabling efficient patch delivery, scalable multi-node inference with minimal communication.
arXiv Detail & Related papers (2026-08-27T15:53:16Z) - CoStream: Composing Simple Behaviors for Generalizable Complex Manipulation [61.25264898597319]
We show that complex manipulation capabilities can emerge naturally from the composition of simple, independent behaviors.<n>We propose CoStream, a framework orchestrating foundation models and diverse sensing modalities into multiple composable core behaviors.<n>We demonstrate CoStream on 8 real-world tasks spanning everyday manipulation and precision assembly, with the strongest gains in contact-rich assembly and object transfer.
arXiv Detail & Related papers (2026-06-24T22:25:19Z) - ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism [0.0]
Large-scale decentralized training can utilize otherwise untapped compute resources.<n>Recent efforts have claimed up to 100x activation compression but rely on complex constrained optimization and diverge from true end-to-end training.<n>We show that ResBMs achieve state-of-the-art 128x activation compression without significant loss in convergence rates and without significant memory or compute overhead.
arXiv Detail & Related papers (2026-04-13T18:40:45Z) - POS-ISP: Pipeline Optimization at the Sequence Level for Task-aware ISP [32.45437409342531]
We propose POS-ISP, a sequence-level RL framework that formulates modular ISP optimization as a global sequence prediction problem.<n>Our method predicts the entire module sequence and its parameters in a single forward pass and optimize the pipeline using a terminal task reward.<n> Experiments across multiple downstream tasks show that POS-ISP improves task performance while reducing computational cost.
arXiv Detail & Related papers (2026-04-08T11:00:33Z) - SWE-Hub: A Unified Production System for Scalable, Executable Software Engineering Tasks [10.106518618464888]
SWE-Hub is an end-to-end system that operationalizes the data factory abstraction.<n>It unifies environment automation, scalable synthesis, and diverse task generation into a coherent production stack.
arXiv Detail & Related papers (2026-02-28T09:53:48Z) - TawPipe: Topology-Aware Weight Pipeline Parallelism for Accelerating Long-Context Large Models Training [9.859893936091813]
Training large language models (LLMs) is fundamentally constrained by limited device memory and costly inter-device communication.<n>We propose TawPipe, which exploits hierarchical bandwidth in distributed clusters for improved communication efficiency.
arXiv Detail & Related papers (2025-11-12T21:06:37Z) - Task-Aware Image Signal Processor for Advanced Visual Perception [32.29324101518987]
Task-Aware Image Signal Processing (TA-ISP) is a compact RAW-to-RGB framework that produces task-oriented representations for pretrained vision models.<n>TA-ISP consistently improves downstream accuracy while markedly reducing parameter count and inference time.<n>It is well suited for deployment on resource-constrained devices.
arXiv Detail & Related papers (2025-09-17T07:16:51Z) - RPCANet++: Deep Interpretable Robust PCA for Sparse Object Segmentation [51.37553739930992]
RPCANet++ is a sparse object segmentation framework that fuses the interpretability of RPCA with efficient deep architectures.<n>Our approach unfolds a relaxed RPCA model into a structured network comprising a Background Approximation Module (BAM), an Object Extraction Module (OEM) and an Image Restoration Module (IRM)<n>Experiments on diverse datasets demonstrate that RPCANet++ achieves state-of-the-art performance under various imaging scenarios.
arXiv Detail & Related papers (2025-08-06T08:19:37Z) - Efficient Multi-Instance Generation with Janus-Pro-Dirven Prompt Parsing [53.295515505026096]
Janus-Pro-driven Prompt Parsing is a prompt- parsing module that bridges text understanding and layout generation.<n>MIGLoRA is a parameter-efficient plug-in integrating Low-Rank Adaptation into UNet (SD1.5) and DiT (SD3) backbones.<n>The proposed method achieves state-of-the-art performance on COCO and LVIS benchmarks while maintaining parameter efficiency.
arXiv Detail & Related papers (2025-03-27T00:59:14Z) - Prior-guided Hierarchical Harmonization Network for Efficient Image Dehazing [50.92820394852817]
We propose a textitPrior-textitguided textitHarmonization Network (PGH$2$Net) for image dehazing.<n>PGH$2$Net is built upon the UNet-like architecture with an efficient encoder and decoder, consisting of two module types.
arXiv Detail & Related papers (2025-03-03T03:36:30Z) - DDU-Net: A Domain Decomposition-Based CNN for High-Resolution Image Segmentation on Multiple GPUs [46.873264197900916]
A domain decomposition-based U-Net architecture is introduced, which partitions input images into non-overlapping patches.<n>A communication network is added to facilitate inter-patch information exchange to enhance the understanding of spatial context.<n>Results show that the approach achieves a $2-3,%$ higher intersection over union (IoU) score compared to the same network without inter-patch communication.
arXiv Detail & Related papers (2024-07-31T01:07:21Z) - Parallel Cross Strip Attention Network for Single Image Dehazing [15.246376325081973]
Single image dehazing aims to restore hazy images and produce clear, high-quality visuals.
Traditional convolutional models struggle with long-range dependencies due to limited receptive field size.
We introduce a novel dehazing network based on Parallel Stripe Cross Attention (PCSA) with a multi-scale strategy.
arXiv Detail & Related papers (2024-05-09T14:50:07Z) - Look-Around Before You Leap: High-Frequency Injected Transformer for Image Restoration [46.96362010335177]
In this paper, we propose HIT, a simple yet effective High-frequency Injected Transformer for image restoration.
Specifically, we design a window-wise injection module (WIM), which incorporates abundant high-frequency details into the feature map, to provide reliable references for restoring high-quality images.
In addition, we introduce a spatial enhancement unit (SEU) to preserve essential spatial relationships that may be lost due to the computations carried out across channel dimensions in the BIM.
arXiv Detail & Related papers (2024-03-30T08:05:00Z) - Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution [91.3781512926942]
Image super-resolution (SR) has witnessed extensive neural network designs from CNN to transformer architectures.
This work investigates the potential of network pruning for super-resolution iteration to take advantage of off-the-shelf network designs and reduce the underlying computational overhead.
We propose a novel Iterative Soft Shrinkage-Percentage (ISS-P) method by optimizing the sparse structure of a randomly network at each and tweaking unimportant weights with a small amount proportional to the magnitude scale on-the-fly.
arXiv Detail & Related papers (2023-03-16T21:06:13Z) - LR-CSNet: Low-Rank Deep Unfolding Network for Image Compressive Sensing [19.74767410530179]
Deep unfolding networks (DUNs) have proven to be a viable approach to compressive sensing (CS)
In this work, we propose a DUN called low-rank CS network (LR-CSNet) for natural image CS.
Our experiments on three widely considered datasets demonstrate the promising performance of LR-CSNet.
arXiv Detail & Related papers (2022-12-18T13:54:11Z) - Learning to Aggregate Multi-Scale Context for Instance Segmentation in
Remote Sensing Images [28.560068780733342]
A novel context aggregation network (CATNet) is proposed to improve the feature extraction process.
The proposed model exploits three lightweight plug-and-play modules, namely dense feature pyramid network (DenseFPN), spatial context pyramid ( SCP), and hierarchical region of interest extractor (HRoIE)
arXiv Detail & Related papers (2021-11-22T08:55:25Z) - PnP-DETR: Towards Efficient Visual Analysis with Transformers [146.55679348493587]
Recently, DETR pioneered the solution vision tasks with transformers, it directly translates the image feature map into the object result.
Recent transformer-based image recognition model andTT show consistent efficiency gain.
arXiv Detail & Related papers (2021-09-15T01:10:30Z) - ReconfigISP: Reconfigurable Camera Image Processing Pipeline [75.46902933531247]
Image Signal Processor (ISP) is crucial component in digital cameras that transforms sensor signals into images for us to perceive and understand.
Existing ISP designs always adopt a fixed architecture, e.g., several sequential modules connected in a rigid order.
In this study, we propose a novel Reconfigurable ISP (ReconfigISP) whose architecture and parameters can be automatically tailored to specific data and tasks.
arXiv Detail & Related papers (2021-09-10T09:56:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.