CCRC: A Change-Aware Captioning and Reasoning Chain for Image Change Captioning and Segmentation

• URL: http://arxiv.org/abs/2606.28724v1
• Date: Sat, 27 Jun 2026 04:07:31 GMT
• Title: CCRC: A Change-Aware Captioning and Reasoning Chain for Image Change Captioning and Segmentation
• Abstract summary: Change-aware Captioning and Reasoning Chain (CCRC) is a dual-chain framework that decouples semantic reasoning from spatial segmentation.<n>CCRC achieves state-of-the-art performance on both synthetic and real-world change detection benchmarks.
• Score: 22.23249458077542
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Understanding and localizing subtle changes between paired images is critical for tasks such as surveillance and image editing. However, traditional Image Change Captioning (ICC) methods lack spatial grounding, limiting their precision. We introduce Image Change Captioning and Segmentation (ICCS), a new multimodal task that jointly requires structured change description and pixel-level localization. To address ICCS, we propose the Change-aware Captioning and Reasoning Chain (CCRC), a dual-chain framework that decouples semantic reasoning from spatial segmentation. The first chain, Chain-of-Change-Captioning (CCC), enhances fine-grained change perception via a visual fusion module based on Multi-Head Change-aware Attention inserted between the visual and language components of a Multimodal Large Language Model (MLLM). CCC also determines whether a change is segmentable. If not, it alone generates the caption. Otherwise, the second chain, Chain-of-Change-Segmenting (CCS), is activated, leveraging spatial priors from CCC and refining masks with a Change-aware Token Refiner for accurate boundary localization. We evaluate CCRC on both synthetic and real-world change detection benchmarks with pixel-level supervision. Experiments show CCRC achieves state-of-the-art performance.

Related papers

• SegDem: Segmentation helps Demosaicing [52.515779223891705]
  Image demosaicing reconstructs a full-color image from incomplete color measurements produced by a sensor covered with a color filter (CFA)<n>Most existing methods formulate demosaicing as pixel-level reconstruction.<n>SegDem is a cross-task decoder representation transfer framework for demosaicing.
  arXiv  Detail & Related papers  (2026-08-08T04:49:20Z)
• Referring Change Detection in Remote Sensing Imagery [49.841833753558575]
  We introduce Referring Change Detection (RCD), which leverages natural language prompts to detect specific classes of changes in remote sensing images.<n>We propose a two-stage framework consisting of (I) textbfRCDNet, a cross-modal fusion network designed for referring change detection, and (II) textbfRCDGen, a diffusion-based synthetic data generation pipeline.
  arXiv  Detail & Related papers  (2025-12-12T16:57:12Z)
• Leveraging Geometric Priors for Unaligned Scene Change Detection [53.523333385654546]
  Unaligned Scene Change Detection aims to detect scene changes between image pairs captured at different times without assuming viewpoint alignment.<n>We introduce geometric priors for the first time to address the core challenges of unaligned SCD.<n>We propose a training-free framework that integrates them with the powerful representations of a visual foundation model.
  arXiv  Detail & Related papers  (2025-09-14T14:31:08Z)
• Robust Change Captioning in Remote Sensing: SECOND-CC Dataset and MModalCC Framework [1.5943223374606597]
  Remote sensing change captioning (RSICC) aims to describe changes between bitemporal images in natural language.<n> SECOND-CC is a novel RSICC dataset featuring high-resolution RGB image pairs, semantic segmentation maps, and diverse real-world scenarios.<n>MModalCC is a multimodal framework that integrates semantic and visual data using advanced attention mechanisms.
  arXiv  Detail & Related papers  (2025-01-17T09:47:27Z)
• Semantic-CD: Remote Sensing Image Semantic Change Detection towards Open-vocabulary Setting [19.663899648983417]
  Traditional change detection methods often face challenges in generalizing across semantic categories in practical scenarios.<n>We introduce a novel approach called Semantic-CD, specifically designed for semantic change detection in remote sensing images.<n>By utilizing CLIP's extensive vocabulary knowledge, our model enhances its ability to generalize across categories.
  arXiv  Detail & Related papers  (2025-01-12T13:22:11Z)
• Enhancing Perception of Key Changes in Remote Sensing Image Change Captioning [49.24306593078429]
  We propose a novel framework for remote sensing image change captioning, guided by Key Change Features and Instruction-tuned (KCFI) KCFI includes a ViTs encoder for extracting bi-temporal remote sensing image features, a key feature perceiver for identifying critical change areas, and a pixel-level change detection decoder. To validate the effectiveness of our approach, we compare it against several state-of-the-art change captioning methods on the LEVIR-CC dataset.
  arXiv  Detail & Related papers  (2024-09-19T09:33:33Z)
• Semantic-CC: Boosting Remote Sensing Image Change Captioning via Foundational Knowledge and Semantic Guidance [19.663899648983417]
  We introduce a novel change captioning (CC) method based on the foundational knowledge and semantic guidance. We validate the proposed method on the LEVIR-CC and LEVIR-CD datasets.
  arXiv  Detail & Related papers  (2024-07-19T05:07:41Z)
• ChangeBind: A Hybrid Change Encoder for Remote Sensing Change Detection [16.62779899494721]
  Change detection (CD) is a fundamental task in remote sensing (RS) which aims to detect the semantic changes between the same geographical regions at different time stamps. We propose an effective Siamese-based framework to encode the semantic changes occurring in the bi-temporal RS images.
  arXiv  Detail & Related papers  (2024-04-26T17:47:14Z)
• A Weakly Supervised Convolutional Network for Change Segmentation and Classification [91.3755431537592]
  We present W-CDNet, a novel weakly supervised change detection network that can be trained with image-level semantic labels. W-CDNet can be trained with two different types of datasets, either containing changed image pairs only or a mixture of changed and unchanged image pairs.
  arXiv  Detail & Related papers  (2020-11-06T20:20:45Z)
• Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation [93.83369981759996]
  We propose a self-supervised equivariant attention mechanism (SEAM) to discover additional supervision and narrow the gap. Our method is based on the observation that equivariance is an implicit constraint in fully supervised semantic segmentation. We propose consistency regularization on predicted CAMs from various transformed images to provide self-supervision for network learning.
  arXiv  Detail & Related papers  (2020-04-09T14:57:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.