Agile Deliberation: Concept Deliberation for Subjective Visual Classification

• URL: http://arxiv.org/abs/2512.10821v1
• Date: Thu, 11 Dec 2025 17:13:09 GMT
• Title: Agile Deliberation: Concept Deliberation for Subjective Visual Classification
• Abstract summary: We operationalize the common strategies in deliberation used by real content moderators into a human-in-the-loop framework called "Agile Deliberation"<n>The system supports users in defining the concept for themselves by exposing them to borderline cases.<n>We find that Agile Deliberation achieves 7.5% higher F1 scores than automated decomposition baselines and more than 3% higher than manual deliberation.
• Score: 28.563231886454762
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: From content moderation to content curation, applications requiring vision classifiers for visual concepts are rapidly expanding. Existing human-in-the-loop approaches typically assume users begin with a clear, stable concept understanding to be able to provide high-quality supervision. In reality, users often start with a vague idea and must iteratively refine it through "concept deliberation", a practice we uncovered through structured interviews with content moderation experts. We operationalize the common strategies in deliberation used by real content moderators into a human-in-the-loop framework called "Agile Deliberation" that explicitly supports evolving and subjective concepts. The system supports users in defining the concept for themselves by exposing them to borderline cases. The system does this with two deliberation stages: (1) concept scoping, which decomposes the initial concept into a structured hierarchy of sub-concepts, and (2) concept iteration, which surfaces semantically borderline examples for user reflection and feedback to iteratively align an image classifier with the user's evolving intent. Since concept deliberation is inherently subjective and interactive, we painstakingly evaluate the framework through 18 user sessions, each 1.5h long, rather than standard benchmarking datasets. We find that Agile Deliberation achieves 7.5% higher F1 scores than automated decomposition baselines and more than 3% higher than manual deliberation, while participants reported clearer conceptual understanding and lower cognitive effort.

Related papers

• ConceptSeg-R1: Segment Any Concept via Meta-Reinforcement Learning [134.61875033137514]
  Recent progress in promptable segmentation has shifted visual perception from object-level localization toward concept-level understanding.<n>We formalize concept segmentation through a three-level taxonomy consisting of context-independent (CI), context-dependent (CD), and context-reasoning (CR) concepts.<n>We propose ConceptSeg-R1, a unified framework that reformulates concept segmentation as rule-induced concept grounding.
  arXiv  Detail & Related papers  (2026-05-19T18:35:38Z)
• Explaining CLIP Zero-shot Predictions Through Concepts [54.05282304471016]
  We introduce EZPC to explain CLIP's zero-shot predictions through human-understandable concepts.<n>Our method projects CLIP's joint image-text embeddings into a concept space learned from language descriptions.<n>Our approach maintains CLIP's strong zero-shot classification accuracy while providing meaningful concept-level explanations.
  arXiv  Detail & Related papers  (2026-03-30T09:31:33Z)
• Beyond Heuristic Prompting: A Concept-Guided Bayesian Framework for Zero-Shot Image Recognition [81.2779530670268]
  Vision-Language Models (VLMs) have significantly advanced zero-shot image recognition.<n>This paper enhances prompt by incorporating class-specific concepts.<n>Our method consistently outperforms state-of-the-art approaches.
  arXiv  Detail & Related papers  (2026-03-09T03:11:11Z)
• Insight: Interpretable Semantic Hierarchies in Vision-Language Encoders [52.94006363830628]
  Language-aligned vision foundation models perform strongly across diverse downstream tasks.<n>Recent works decompose these representations into human-interpretable concepts, but provide poor spatial grounding and are limited to image classification tasks.<n>We propose Insight, a language-aligned concept foundation model that provides fine-grained concepts, which are human-interpretable and spatially grounded in the input image.
  arXiv  Detail & Related papers  (2026-01-20T09:57:26Z)
• ConceptScope: Characterizing Dataset Bias via Disentangled Visual Concepts [54.60525564599342]
  ConceptScope is a scalable and automated framework for analyzing visual datasets.<n>It categorizes concepts into target, context, and bias types based on their semantic relevance and statistical correlation to class labels.<n>It reliably detects known biases and uncovers previously unannotated ones.
  arXiv  Detail & Related papers  (2025-10-30T06:46:17Z)
• FaCT: Faithful Concept Traces for Explaining Neural Network Decisions [56.796533084868884]
  Deep networks have shown remarkable performance across a wide range of tasks, yet getting a global concept-level understanding of how they function remains a key challenge.<n>We put emphasis on the faithfulness of concept-based explanations and propose a new model with model-inherent mechanistic concept-explanations.<n>Our concepts are shared across classes and, from any layer, their contribution to the logit and their input-visualization can be faithfully traced.
  arXiv  Detail & Related papers  (2025-10-29T13:35:46Z)
• Analyzing Latent Concepts in Code Language Models [10.214183897113118]
  We propose Code Concept Analysis (CoCoA): a global post-hoc interpretability framework.<n>CoCoA uncovers emergent lexical, syntactic, and semantic structures in a code language model's representation space.<n>We propose a hybrid annotation pipeline that combines static analysis tool-based syntactic alignment with prompt-engineered large language models.
  arXiv  Detail & Related papers  (2025-10-01T03:53:21Z)
• What You Perceive Is What You Conceive: A Cognition-Inspired Framework for Open Vocabulary Image Segmentation [65.80512502962071]
  Open vocabulary image segmentation tackles the challenge of recognizing dynamically adjustable, predefined novel categories at inference time.<n>Existing paradigms typically perform class-agnostic region segmentation followed by category matching, leading to poor alignment between region segmentation and target concepts.<n>We propose a novel Cognition-Inspired Framework for open vocabulary image segmentation that emulates the human visual recognition process.
  arXiv  Detail & Related papers  (2025-05-26T06:33:48Z)
• Concept Guided Co-salient Object Detection [22.82243087156918]
  ConceptCoSOD is a concept-guided framework that introduces high-level semantic knowledge to enhance co-saliency detection.<n>By extracting shared text-based concepts from the input image group, ConceptCoSOD provides semantic guidance that anchors the detection process.
  arXiv  Detail & Related papers  (2024-12-21T12:47:12Z)
• Discover-then-Name: Task-Agnostic Concept Bottlenecks via Automated Concept Discovery [52.498055901649025]
  Concept Bottleneck Models (CBMs) have been proposed to address the 'black-box' problem of deep neural networks. We propose a novel CBM approach -- called Discover-then-Name-CBM (DN-CBM) -- that inverts the typical paradigm. Our concept extraction strategy is efficient, since it is agnostic to the downstream task, and uses concepts already known to the model.
  arXiv  Detail & Related papers  (2024-07-19T17:50:11Z)
• Knowledge graphs for empirical concept retrieval [1.06378109904813]
  Concept-based explainable AI is promising as a tool to improve the understanding of complex models at the premises of a given user. Here, we present a workflow for user-driven data collection in both text and image domains. We test the retrieved concept datasets on two concept-based explainability methods, namely concept activation vectors (CAVs) and concept activation regions (CARs)
  arXiv  Detail & Related papers  (2024-04-10T13:47:22Z)
• CEIR: Concept-based Explainable Image Representation Learning [0.4198865250277024]
  We introduce Concept-based Explainable Image Representation (CEIR) to derive high-quality representations without label dependency. Our method exhibits state-of-the-art unsupervised clustering performance on benchmarks such as CIFAR10, CIFAR100, and STL10. CEIR can seamlessly extract the related concept from open-world images without fine-tuning.
  arXiv  Detail & Related papers  (2023-12-17T15:37:41Z)
• Agile Modeling: From Concept to Classifier in Minutes [35.03003329814567]
  We introduce the problem of Agile Modeling: the process of turning any subjective visual concept into a computer vision model. We show through a user study that users can create classifiers with minimal effort under 30 minutes. We compare this user driven process with the traditional crowdsourcing paradigm and find that the crowd's notion often differs from that of the user's.
  arXiv  Detail & Related papers  (2023-02-25T01:18:09Z)
• Visual Superordinate Abstraction for Robust Concept Learning [80.15940996821541]
  Concept learning constructs visual representations that are connected to linguistic semantics. We ascribe the bottleneck to a failure of exploring the intrinsic semantic hierarchy of visual concepts. We propose a visual superordinate abstraction framework for explicitly modeling semantic-aware visual subspaces.
  arXiv  Detail & Related papers  (2022-05-28T14:27:38Z)
• Quantifying Learnability and Describability of Visual Concepts Emerging in Representation Learning [91.58529629419135]
  We consider how to characterise visual groupings discovered automatically by deep neural networks. We introduce two concepts, visual learnability and describability, that can be used to quantify the interpretability of arbitrary image groupings.
  arXiv  Detail & Related papers  (2020-10-27T18:41:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.