HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrieval

• URL: http://arxiv.org/abs/2604.18037v1
• Date: Mon, 20 Apr 2026 10:02:18 GMT
• Title: HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrieval
• Abstract summary: Composed Image Retrieval (CIR) is a flexible image retrieval paradigm that enables users to accurately locate the target image.<n>This paper proposes a cHrono-synergiA roBust progressIve learning framework for composed image reTrieval (HABIT)<n>Experiments conducted on two standard CIR datasets demonstrate that HABIT significantly outperforms most methods under various noise ratios.
• Score: 32.85064790572752
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Composed Image Retrieval (CIR) is a flexible image retrieval paradigm that enables users to accurately locate the target image through a multimodal query composed of a reference image and modification text. Although this task has demonstrated promising applications in personalized search and recommendation systems, it encounters a severe challenge in practical scenarios known as the Noise Triplet Correspondence (NTC) problem. This issue primarily arises from the high cost and subjectivity involved in annotating triplet data. To address this problem, we identify two central challenges: the precise estimation of composed semantic discrepancy and the insufficient progressive adaptation to modification discrepancy. To tackle these challenges, we propose a cHrono-synergiA roBust progressIve learning framework for composed image reTrieval (HABIT), which consists of two core modules. First, the Mutual Knowledge Estimation Module quantifies sample cleanliness by calculating the Transition Rate of mutual information between the composed feature and the target image, thereby effectively identifying clean samples that align with the intended modification semantics. Second, the Dual-consistency Progressive Learning Module introduces a collaborative mechanism between the historical and current models, simulating human habit formation to retain good habits and calibrate bad habits, ultimately enabling robust learning under the presence of NTC. Extensive experiments conducted on two standard CIR datasets demonstrate that HABIT significantly outperforms most methods under various noise ratios, exhibiting superior robustness and retrieval performance. Codes are available at https://github.com/Lee-zixu/HABIT

Related papers

• Focus When Necessary: Adaptive Routing and Collaborative Grounding for Training-Free Visual Grounding [56.38477453373368]
  LazyMCoT is a dynamic and training-free framework that adaptively allocates visual grounding efforts based on sample difficulty.<n>LazyMCoT rivals training-based approaches by simultaneously improving reasoning accuracy and reducing average inference latency.
  arXiv  Detail & Related papers  (2026-06-15T03:17:44Z)
• ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrieval [60.051600134831226]
  This paper systematically investigates the Noisy Triplet Correspondence (NTC) problem introduced by annotations.<n>We propose a Cone-based robuSt noisE-unlearning comPositional network (ConeSep) to address these challenges.
  arXiv  Detail & Related papers  (2026-04-22T08:59:21Z)
• Robust Remote Sensing Image-Text Retrieval with Noisy Correspondence [24.863417464867776]
  We propose a novel Robust Remote Sensing Image-Text Retrieval (RRSITR) paradigm that designs a self-paced learning strategy to mimic human cognitive learning patterns.<n>Experiments on three popular benchmark datasets demonstrate that the proposed RRSITR significantly outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-03-30T07:55:07Z)
• HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Network [32.657095507841085]
  Composed Image Retrieval (CIR) is a challenging image retrieval paradigm.<n>We propose a dual-patHsItional coNtextualized neTwork (HINT) to perform contextualized encoding and amplify the similarity differences between matching and non-matching samples.<n>Our HINT model achieves optimal performance on all metrics across two CIR benchmark datasets.
  arXiv  Detail & Related papers  (2026-03-27T12:01:40Z)
• Vision-Free Retrieval: Rethinking Multimodal Search with Textual Scene Descriptions [81.33113485830711]
  We introduce a vision-free, single-encoder retrieval pipeline for vision-language models.<n>We migrate to a text-to-text paradigm with the assistance of VLLM-generated structured image descriptions.<n>Our approach achieves state-of-the-art zero-shot performance on multiple retrieval and compositionality benchmarks.
  arXiv  Detail & Related papers  (2025-09-23T16:22:27Z)
• CoLLM: A Large Language Model for Composed Image Retrieval [76.29725148964368]
  Composed Image Retrieval (CIR) is a complex task that aims to retrieve images based on a multimodal query.<n>We present CoLLM, a one-stop framework that generates triplets on-the-fly from image-caption pairs.<n>We leverage Large Language Models (LLMs) to generate joint embeddings of reference images and modification texts.
  arXiv  Detail & Related papers  (2025-03-25T17:59:50Z)
• Modality and Task Adaptation for Enhanced Zero-shot Composed Image Retrieval [20.612534837883892]
  Zero-Shot Composed Image Retrieval (ZS-CIR) is designed to retrieve target images using bi-modal (image+text) queries.<n>We propose a lightweight post-hoc framework, consisting of two components.<n>Experiments show that, with the incorporation of our proposed components, inversion-based methods achieve significant improvements.
  arXiv  Detail & Related papers  (2024-10-31T08:49:05Z)
• Symmetrical Bidirectional Knowledge Alignment for Zero-Shot Sketch-Based Image Retrieval [69.46139774646308]
  This paper studies the problem of zero-shot sketch-based image retrieval (ZS-SBIR) It aims to use sketches from unseen categories as queries to match the images of the same category. We propose a novel Symmetrical Bidirectional Knowledge Alignment for zero-shot sketch-based image retrieval (SBKA)
  arXiv  Detail & Related papers  (2023-12-16T04:50:34Z)
• Noisy-Correspondence Learning for Text-to-Image Person Re-identification [50.07634676709067]
  We propose a novel Robust Dual Embedding method (RDE) to learn robust visual-semantic associations even with noisy correspondences. Our method achieves state-of-the-art results both with and without synthetic noisy correspondences on three datasets.
  arXiv  Detail & Related papers  (2023-08-19T05:34:13Z)
• CoSformer: Detecting Co-Salient Object with Transformers [2.3148470932285665]
  Co-Salient Object Detection (CoSOD) aims at simulating the human visual system to discover the common and salient objects from a group of relevant images. We propose the Co-Salient Object Detection Transformer (CoSformer) network to capture both salient and common visual patterns from multiple images.
  arXiv  Detail & Related papers  (2021-04-30T02:39:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.