IntRec: Intent-based Retrieval with Contrastive Refinement

• URL: http://arxiv.org/abs/2602.17639v1
• Date: Thu, 19 Feb 2026 18:50:53 GMT
• Title: IntRec: Intent-based Retrieval with Contrastive Refinement
• Abstract summary: IntRec is an interactive object retrieval framework that refines predictions based on user feedback.<n>At its core is an Intent State (IS) that maintains dual memory sets for positive anchors (confirmed cues) and negative constraints (rejected hypotheses)
• Score: 42.24292951933703
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Retrieving user-specified objects from complex scenes remains a challenging task, especially when queries are ambiguous or involve multiple similar objects. Existing open-vocabulary detectors operate in a one-shot manner, lacking the ability to refine predictions based on user feedback. To address this, we propose IntRec, an interactive object retrieval framework that refines predictions based on user feedback. At its core is an Intent State (IS) that maintains dual memory sets for positive anchors (confirmed cues) and negative constraints (rejected hypotheses). A contrastive alignment function ranks candidate objects by maximizing similarity to positive cues while penalizing rejected ones, enabling fine-grained disambiguation in cluttered scenes. Our interactive framework provides substantial improvements in retrieval accuracy without additional supervision. On LVIS, IntRec achieves 35.4 AP, outperforming OVMR, CoDet, and CAKE by +2.3, +3.7, and +0.5, respectively. On the challenging LVIS-Ambiguous benchmark, it improves performance by +7.9 AP over its one-shot baseline after a single corrective feedback, with less than 30 ms of added latency per interaction.

Related papers

• Action-Aligned Retrieval with Pairwise Multimodal Reranking for Text-Based Person Anomaly Search [10.617164505348283]
  Text-based person anomaly search requires distinguishing individuals based on fine-grained, context-dependent behaviors rather than mere appearance.<n>Existing methods struggle to capture these context-conditioned actions.<n>We propose a unified three-stage coarse-to-fine framework that combines action-aligned retrieval with pairwise multimodal reranking.
  arXiv  Detail & Related papers  (2026-08-24T17:04:34Z)
• SEER: A Self-Grounded Evidence Interface for Controlled Spatial Relation Classification [71.9783246097687]
  SEER hides candidate relations during pair localization, constructs a query-specific view with explicit subject/object roles, and retains the full image and sparse box geometry as complementary evidence.<n>For relation-choice protocols with exact inverse support, an optional refinement swaps the entity roles and changes the forward decision only when exactly one visual state obeys the corresponding inverse relation.<n>The unchanged protocol yields +4.35 to +11.79 on all 2,434 filtered EmbSpatial pair-relation questions across three models.
  arXiv  Detail & Related papers  (2026-08-04T13:16:15Z)
• SPEAR: Selection-aware Personalized End-to-end Adaptive Rewriting and Retrieval for Community Search [16.046037914956504]
  We propose SPEAR, which integrates three components that each target one failure mode.<n>The proposed framework improves rewrite semantic similarity@10 by +18.2 and click recall@10 by +99.5 over the production baseline.
  arXiv  Detail & Related papers  (2026-08-03T06:03:58Z)
• Contrastive Reflection for Iterative Prompt Optimization [0.6533652962118279]
  We present Contrastive Reflection, an iterative prompt-optimization framework for agentic IR.<n>We instantiate the framework with a tree-based slice selector, but the contribution is the contrastive loop rather than the tree itself.
  arXiv  Detail & Related papers  (2026-06-29T19:16:07Z)
• AbstRAG: Learning to Abstract for Retrieval Problems [23.379898867224355]
  AbstRAG decomposes the query--evidence gap into expression, conceptual, intent--evidence, and event-type components.<n>It outperforms on nDCG@10 in 18 of 21 paired-bootstrap contrasts and improves generation accuracy by 1.9%, 5.2%, and 4.0%.
  arXiv  Detail & Related papers  (2026-06-08T13:14:01Z)
• CoVR-R:Reason-Aware Composed Video Retrieval [25.765681895305736]
  Composed Video Retrieval (CoVR) aims to find a target video given a reference video and a textual modification.<n>Prior work assumes the modification text fully specifies the visual changes, overlooking after-effects and implicit consequences.<n>We introduce a reasoning-first, zero-shot approach that leverages large multimodal models to infer causal and temporal consequences implied by the edit.
  arXiv  Detail & Related papers  (2026-03-20T17:59:25Z)
• Robust Relevance Feedback for Interactive Known-Item Video Search [30.382002857815497]
  We introduce a pairwise relative judgment feedback that improves the stability of top-k selections.<n>We decompose user perception into multiple sub-perceptions, each represented as an independent embedding space.<n>We develop a predictive user model that estimates the combination of sub-perceptions based on each user feedback instance.
  arXiv  Detail & Related papers  (2025-05-21T05:31:49Z)
• iEBAKER: Improved Remote Sensing Image-Text Retrieval Framework via Eliminate Before Align and Keyword Explicit Reasoning [80.44805667907612]
  iEBAKER is an innovative strategy to filter weakly correlated sample pairs.<n>We introduce an alternative Sort After Reversed Retrieval (SAR) strategy.<n>We incorporate a Keyword Explicit Reasoning (KER) module to facilitate the beneficial impact of subtle key concept distinctions.
  arXiv  Detail & Related papers  (2025-04-08T03:40:19Z)
• Bidirectional Decoding: Improving Action Chunking via Guided Test-Time Sampling [51.38330727868982]
  We show how action chunking impacts the divergence between a learner and a demonstrator.<n>We propose Bidirectional Decoding (BID), a test-time inference algorithm that bridges action chunking with closed-loop adaptation.<n>Our method boosts the performance of two state-of-the-art generative policies across seven simulation benchmarks and two real-world tasks.
  arXiv  Detail & Related papers  (2024-08-30T15:39:34Z)
• A Reproducibility Study of PLAID [25.86500025007641]
  We compare PLAID with an important baseline missing from the paper: re-ranking a lexical system. We find that applying ColBERTv2 as a re-ranker atop an initial pool of BM25 results provides better efficiency-effectiveness trade-offs in low-latency settings. We find that recently proposed modifications to re-ranking that pull in the neighbors of top-scoring documents overcome this limitation.
  arXiv  Detail & Related papers  (2024-04-23T12:46:53Z)
• Spatial-Temporal Graph Enhanced DETR Towards Multi-Frame 3D Object Detection [54.041049052843604]
  We present STEMD, a novel end-to-end framework that enhances the DETR-like paradigm for multi-frame 3D object detection. First, to model the inter-object spatial interaction and complex temporal dependencies, we introduce the spatial-temporal graph attention network. Finally, it poses a challenge for the network to distinguish between the positive query and other highly similar queries that are not the best match.
  arXiv  Detail & Related papers  (2023-07-01T13:53:14Z)
• ReFIT: Relevance Feedback from a Reranker during Inference [109.33278799999582]
  Retrieve-and-rerank is a prevalent framework in neural information retrieval. We propose to leverage the reranker to improve recall by making it provide relevance feedback to the retriever at inference time.
  arXiv  Detail & Related papers  (2023-05-19T15:30:33Z)
• TSAA: A Two-Stage Anchor Assignment Method towards Anchor Drift in Crowded Object Detection [0.0]
  A positive anchor does not always regress toward the object that overlaps it the most when multiple objects overlap. A simple but efficient adaptive two-stage anchor assignment (TSAA) method is proposed.
  arXiv  Detail & Related papers  (2022-11-02T02:05:00Z)
• ReAct: Temporal Action Detection with Relational Queries [84.76646044604055]
  This work aims at advancing temporal action detection (TAD) using an encoder-decoder framework with action queries. We first propose a relational attention mechanism in the decoder, which guides the attention among queries based on their relations. Lastly, we propose to predict the localization quality of each action query at inference in order to distinguish high-quality queries.
  arXiv  Detail & Related papers  (2022-07-14T17:46:37Z)
• Bootstrapping User and Item Representations for One-Class Collaborative Filtering [24.30834981766022]
  One-class collaborative filtering (OCCF) is to identify user-item pairs that are positively-related but have not been interacted yet. This paper proposes a novel OCCF framework, named as BUIR, which does not require negative sampling.
  arXiv  Detail & Related papers  (2021-05-13T14:24:13Z)
• RepPoints V2: Verification Meets Regression for Object Detection [65.120827759348]
  We introduce verification tasks into the localization prediction of RepPoints. RepPoints v2 provides consistent improvements of about 2.0 mAP over the original RepPoints. We show that the proposed approach can more generally elevate other object detection frameworks as well as applications such as instance segmentation.
  arXiv  Detail & Related papers  (2020-07-16T17:57:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.