RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning

• URL: http://arxiv.org/abs/2606.28266v1
• Date: Fri, 26 Jun 2026 16:57:40 GMT
• Title: RSICCLLM: A Multimodal Large Language Model for Remote Sensing Image Change Captioning
• Abstract summary: Remote Sensing Image Change Captioning (RSICC) aims to describe changes between bi-temporal remote sensing images.<n>We propose RSICCLLM, the first post-training framework for large vision-language models in RSICC.
• Score: 49.24254347822435
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Remote Sensing Image Change Captioning (RSICC) aims to describe changes between bi-temporal remote sensing images and holds significant research and application value. However, most existing methods rely on conventional deep learning architectures, and the limited model capacity constrains performance. Although large-model post-training techniques have achieved great success in general domains, their direct transfer to RSICC remains challenging due to data scarcity and the need for fine-grained change understanding. To address this, we propose RSICCLLM, the first post-training framework for large vision-language models in RSICC. Specifically, we design a data generation paradigm, release the instruction dataset RSICI, and establish a task-specific RSICC benchmark. We further introduce Difference-aware Supervised Fine-tuning to explicitly extract change representations and guide the model in perceiving and understanding temporal differences. In addition, we propose Dual-Negative Preference Optimization (DNPO), which employs two complementary negative-sample construction strategies to construct the preference dataset RSICP and further refine model performance. Extensive experiments validate the superior capability of RSICCLLM, which achieves outstanding results with only 7B parameters, surpassing models of substantially larger scales. The code and dataset will be made publicly available at https://github.com/keaill/RSICCLLM.

Related papers

• Generalized Synthetic Image Detection with Enhanced RGB-Noise Representation Learning [33.97020349697987]
  We propose RNSIDNet, a novel forensic framework that achieves robust detection through enhanced RGB-Noise representation learning.<n>Specifically, our method employs a dual-branch architecture where global RGB semantics, extracted by an attention-refined CLIP backbone, dynamically modulate high-frequency noise artifacts captured by Bayar convolutions via a Feature-wise Linear Modulation (FiLM) module.<n>To further enhance the learned representations, we design a Hard Sample-aware Contrastive Learning (HSCL) strategy.
  arXiv  Detail & Related papers  (2026-07-07T14:52:22Z)
• Semantic-Driven Scale and Spatial Selection for Efficient Cross-Modal Alignment in Referring Remote Sensing Image Segmentation [14.492779733437082]
  Referring Remote Sensing Image seeks to localize and segment the target object or region specified by a natural language expression in a remote sensing image.<n>Existing RRSIS models have benefited from large-scale foundation models, but they predominantly rely on full fine-tuning.<n>We propose a novel framework, Semantic-driven Scale and Spatial Selection for Efficient Cross-modal Alignment.
  arXiv  Detail & Related papers  (2026-06-29T12:54:10Z)
• Dual-domain Adaptation Networks for Realistic Image Super-resolution [81.34345637776408]
  Realistic image super-resolution (SR) focuses on transforming real-world low-resolution (LR) images into high-resolution (HR) ones.<n>Current methods struggle with limited real-world LR-HR data, impacting the learning of basic image features.<n>We introduce a novel approach, which is able to efficiently adapt pre-trained image SR models from simulated to real-world datasets.
  arXiv  Detail & Related papers  (2025-11-21T12:57:23Z)
• Bayesian Natural Gradient Fine-Tuning of CLIP Models via Kalman Filtering [4.681301898136104]
  Few fine-tuning is a major challenge to achieve optimal performance in vision-language pre-trained models.<n>We propose a Bayesian approximation of Natural Descent (NGD) using a Kalman filter for CLIP models.<n>Our algorithm consistently achieves superior--or comparable--ID performance compared to state-of-the-art baselines.
  arXiv  Detail & Related papers  (2025-11-03T16:00:45Z)
• CIR-CoT: Towards Interpretable Composed Image Retrieval via End-to-End Chain-of-Thought Reasoning [93.05917922306196]
  Composed Image Retrieval (CIR) aims to find a target image from a reference image and a modification text.<n>CIR-CoT is the first end-to-end retrieval-oriented MLLM designed to integrate explicit Chain-of-Thought (CoT) reasoning.
  arXiv  Detail & Related papers  (2025-10-09T09:41:45Z)
• Superpixel-informed Continuous Low-Rank Tensor Representation for Multi-Dimensional Data Recovery [17.554617777765866]
  Low-rank tensor representation (LRTR) has emerged as a powerful tool for multi-dimensional data processing.<n>Superpixel-informed Continuous low-rank Representation (SCTR) framework enables continuous and flexible modeling of multi-dimensional data.<n>SCTR achieves 3-5 dB PSNR improvements over existing LRTR-based methods across multispectral images, videos, and color images.
  arXiv  Detail & Related papers  (2025-08-17T06:58:42Z)
• VELoRA: A Low-Rank Adaptation Approach for Efficient RGB-Event based Recognition [54.27379947727035]
  This paper proposes a novel PEFT strategy to adapt the pre-trained foundation vision models for the RGB-Event-based classification.<n>The frame difference of the dual modalities is also considered to capture the motion cues via the frame difference backbone network.<n>The source code and pre-trained models will be released on urlhttps://github.com/Event-AHU/VELoRA.
  arXiv  Detail & Related papers  (2024-12-28T07:38:23Z)
• RS-MoE: A Vision-Language Model with Mixture of Experts for Remote Sensing Image Captioning and Visual Question Answering [23.699493284403967]
  This paper proposes RS-MoE, a first Mixture of Expert based VLM specifically customized for remote sensing domain.<n>Unlike traditional MoE models, the core of RS-MoE is the MoE Block, which incorporates a novel Instruction Router and multiple lightweight Large Language Models (LLMs) as expert models.<n>We show that our model achieves state-of-the-art performance in generating precise and contextually relevant captions.
  arXiv  Detail & Related papers  (2024-11-03T15:05:49Z)
• Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution [91.3781512926942]
  Image super-resolution (SR) has witnessed extensive neural network designs from CNN to transformer architectures. This work investigates the potential of network pruning for super-resolution iteration to take advantage of off-the-shelf network designs and reduce the underlying computational overhead. We propose a novel Iterative Soft Shrinkage-Percentage (ISS-P) method by optimizing the sparse structure of a randomly network at each and tweaking unimportant weights with a small amount proportional to the magnitude scale on-the-fly.
  arXiv  Detail & Related papers  (2023-03-16T21:06:13Z)
• CoMAE: Single Model Hybrid Pre-training on Small-Scale RGB-D Datasets [50.6643933702394]
  We present a single-model self-supervised hybrid pre-training framework for RGB and depth modalities, termed as CoMAE. Our CoMAE presents a curriculum learning strategy to unify the two popular self-supervised representation learning algorithms: contrastive learning and masked image modeling.
  arXiv  Detail & Related papers  (2023-02-13T07:09:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.