High-Fidelity Lake Extraction via Two-Stage Prompt Enhancement: Establishing a Novel Baseline and Benchmark

• URL: http://arxiv.org/abs/2308.08443v2
• Date: Sun, 31 Mar 2024 12:39:48 GMT
• Title: High-Fidelity Lake Extraction via Two-Stage Prompt Enhancement: Establishing a Novel Baseline and Benchmark
• Abstract summary: Lake extraction from remote sensing imagery is a complex challenge due to the varied lake shapes and data noise. This paper introduces a prompt-based dataset construction approach that provides approximate lake locations. We also propose a two-stage prompt enhancement framework, LEPrompter, with prompt-based and prompt-free stages during training.
• Score: 18.399869837003457
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Lake extraction from remote sensing imagery is a complex challenge due to the varied lake shapes and data noise. Current methods rely on multispectral image datasets, making it challenging to learn lake features accurately from pixel arrangements. This, in turn, affects model learning and the creation of accurate segmentation masks. This paper introduces a prompt-based dataset construction approach that provides approximate lake locations using point, box, and mask prompts. We also propose a two-stage prompt enhancement framework, LEPrompter, with prompt-based and prompt-free stages during training. The prompt-based stage employs a prompt encoder to extract prior information, integrating prompt tokens and image embedding through self- and cross-attention in the prompt decoder. Prompts are deactivated to ensure independence during inference, enabling automated lake extraction without introducing additional parameters and GFlops. Extensive experiments showcase performance improvements of our proposed approach compared to the previous state-of-the-art method. The source code is available at https://github.com/BastianChen/LEPrompter.

Related papers

• VLZip: Unified Visual and Textual Compression for Interleaved Long-Context Modeling [81.92510561363197]
  We introduce VLZip, a framework that unifies visual and textual compression for high-fidelity reasoning within a pure Transformer.<n>We also introduce LongVLBench, a new benchmark derived from video narratives that demands holistic, narrative-level reasoning.
  arXiv  Detail & Related papers  (2026-08-09T10:31:03Z)
• SGDiff: Scene Graph Guided Diffusion Model for Image Collaborative SegCaptioning [53.638998508418545]
  This paper introduces a new task Image Collaborative and Captioning'' (SegCaptioning)<n>SegCaptioning aims to translate a straightforward prompt, like a bounding box around an object, into diverse semantic interpretations represented by (caption, masks) pairs.<n>This task poses significant challenges, including accurately capturing a user's intention from a minimal prompt while simultaneously predicting multiple semantically aligned caption words and masks.
  arXiv  Detail & Related papers  (2025-12-01T18:33:04Z)
• Prompt-Driven Image Analysis with Multimodal Generative AI: Detection, Segmentation, Inpainting, and Interpretation [0.0]
  We present a practical case study of a unified pipeline that combines open-vocabulary detection, promptable segmentation, text-conditioned inpainting, and vision-language description.<n>We highlight integration choices that reduce brittleness, including threshold adjustments, mask inspection with light morphology, and resource-aware defaults.
  arXiv  Detail & Related papers  (2025-09-10T11:00:12Z)
• Pixel-SAIL: Single Transformer For Pixel-Grounded Understanding [65.11838260342586]
  We present Pixel-SAIL, a single transformer for pixel-wise MLLM tasks. We propose a novel visual prompt injection strategy to enable the single transformer to understand visual prompt inputs. We also introduce a vision expert distillation strategy to efficiently enhance the single transformer's fine-grained feature extraction capability.
  arXiv  Detail & Related papers  (2025-04-14T17:52:22Z)
• Fwd2Bot: LVLM Visual Token Compression with Double Forward Bottleneck [40.21228703978429]
  We propose a novel compression approach, called Fwd2Bot, that uses the LVLM itself to compress the visual information in a task-agnostic manner. Fwd2Bot results in highly-informative compressed representations suitable for both generative and discriminative tasks.
  arXiv  Detail & Related papers  (2025-03-27T17:57:07Z)
• Mixture of Prompt Learning for Vision Language Models [12.828490399811376]
  We propose a mixture of soft prompt learning method incorporating a routing module. This module is able to capture a dataset's varied styles and dynamically selects the most suitable prompts for each instance. We also implement semantically grouped text-level supervision, initializing each soft prompt with the token embeddings of manually designed templates from its group.
  arXiv  Detail & Related papers  (2024-09-18T14:25:02Z)
• Are You Copying My Prompt? Protecting the Copyright of Vision Prompt for VPaaS via Watermark [4.071771108540602]
  Visual Prompt Learning (VPL) differs from traditional fine-tuning methods in reducing significant resource consumption by avoiding updating pre-trained model parameters. Developers of Visual Prompts as a Service (V) have emerged. These developers profit by providing well-crafted prompts to authorized customers. However, a significant drawback is that prompts can be easily copied and redistributed, threatening the intellectual property of V developers.
  arXiv  Detail & Related papers  (2024-05-24T02:31:03Z)
• Locate, Assign, Refine: Taming Customized Image Inpainting with Text-Subject Guidance [17.251982243534144]
  LAR-Gen is a novel approach for image inpainting that enables seamless inpainting of masked scene images. Our approach adopts a coarse-to-fine manner to ensure subject identity preservation and local semantic coherence. Experiments and varied application scenarios demonstrate the superiority of LAR-Gen in terms of both identity preservation and text semantic consistency.
  arXiv  Detail & Related papers  (2024-03-28T16:07:55Z)
• InfoPrompt: Information-Theoretic Soft Prompt Tuning for Natural Language Understanding [51.48361798508375]
  We develop an information-theoretic framework that formulates soft prompt tuning as maximizing mutual information between prompts and other model parameters. We show that InfoPrompt can significantly accelerate the convergence of the prompt tuning and outperform traditional prompt tuning methods.
  arXiv  Detail & Related papers  (2023-06-08T04:31:48Z)
• CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Model [60.30099369475092]
  Supervised crowd counting relies heavily on costly manual labeling. We propose a novel unsupervised framework for crowd counting, named CrowdCLIP. CrowdCLIP achieves superior performance compared to previous unsupervised state-of-the-art counting methods.
  arXiv  Detail & Related papers  (2023-04-09T12:56:54Z)
• SelfPromer: Self-Prompt Dehazing Transformers with Depth-Consistency [51.92434113232977]
  This work presents an effective depth-consistency self-prompt Transformer for image dehazing. It is motivated by an observation that the estimated depths of an image with haze residuals and its clear counterpart vary. By incorporating the prompt, prompt embedding, and prompt attention into an encoder-decoder network based on VQGAN, we can achieve better perception quality.
  arXiv  Detail & Related papers  (2023-03-13T11:47:24Z)
• Dual Modality Prompt Tuning for Vision-Language Pre-Trained Model [39.722927180264584]
  We propose a novel Dual-modality Prompt Tuning (DPT) paradigm through learning text and visual prompts simultaneously. To make the final image feature concentrate more on the target visual concept, a Class-Aware Visual Prompt Tuning scheme is proposed.
  arXiv  Detail & Related papers  (2022-08-17T15:06:36Z)
• ADAPT: Vision-Language Navigation with Modality-Aligned Action Prompts [92.92047324641622]
  We propose modAlity-aligneD Action PrompTs (ADAPT) for Vision-Language Navigation (VLN) ADAPT provides the VLN agent with action prompts to enable the explicit learning of action-level modality alignment. Experimental results on both R2R and RxR show the superiority of ADAPT over state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-05-31T02:41:31Z)
• BatchFormerV2: Exploring Sample Relationships for Dense Representation Learning [88.82371069668147]
  BatchFormerV2 is a more general batch Transformer module, which enables exploring sample relationships for dense representation learning. BatchFormerV2 consistently improves current DETR-based detection methods by over 1.3%.
  arXiv  Detail & Related papers  (2022-04-04T05:53:42Z)
• PromptDet: Expand Your Detector Vocabulary with Uncurated Images [47.600059694034]
  The goal of this work is to establish a scalable pipeline for expanding an object detector towards novel/unseen categories, using zero manual annotations. We propose a two-stage open-vocabulary object detector that categorises each box proposal by a classifier generated from the text encoder of a pre-trained visual-language model. To scale up the learning procedure towards detecting a wider spectrum of objects, we exploit the available online resource, iteratively updating the prompts, and later self-training the proposed detector with pseudo labels generated on a large corpus of noisy, uncurated web images.
  arXiv  Detail & Related papers  (2022-03-30T17:50:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.