FloodVision: Urban Flood Depth Estimation Using Foundation Vision-Language Models and Domain Knowledge Graph

• URL: http://arxiv.org/abs/2509.04772v1
• Date: Fri, 05 Sep 2025 03:05:18 GMT
• Title: FloodVision: Urban Flood Depth Estimation Using Foundation Vision-Language Models and Domain Knowledge Graph
• Abstract summary: FloodVision is a zero-shot framework that combines the semantic reasoning abilities of the foundation vision-language model GPT-4o with a structured domain knowledge graph.<n>FloodVision achieves a mean absolute error of 8.17 cm, reducing the GPT-4o baseline 10.28 cm by 20.5% and surpassing prior CNN-based methods.
• Score: 1.0323063834827415
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Timely and accurate floodwater depth estimation is critical for road accessibility and emergency response. While recent computer vision methods have enabled flood detection, they suffer from both accuracy limitations and poor generalization due to dependence on fixed object detectors and task-specific training. To enable accurate depth estimation that can generalize across diverse flood scenarios, this paper presents FloodVision, a zero-shot framework that combines the semantic reasoning abilities of the foundation vision-language model GPT-4o with a structured domain knowledge graph. The knowledge graph encodes canonical real-world dimensions for common urban objects including vehicles, people, and infrastructure elements to ground the model's reasoning in physical reality. FloodVision dynamically identifies visible reference objects in RGB images, retrieves verified heights from the knowledge graph to mitigate hallucination, estimates submergence ratios, and applies statistical outlier filtering to compute final depth values. Evaluated on 110 crowdsourced images from MyCoast New York, FloodVision achieves a mean absolute error of 8.17 cm, reducing the GPT-4o baseline 10.28 cm by 20.5% and surpassing prior CNN-based methods. The system generalizes well across varying scenes and operates in near real-time, making it suitable for future integration into digital twin platforms and citizen-reporting apps for smart city flood resilience.

Related papers

• Assessing the Benefits of Combining Advanced Deep Learning Techniques for Post-Disaster Building Damage Assessment from UAV Imagery [3.016488960368601]
  We propose a hybrid framework that decouples detection from damage assessment.<n>A CV model first detects buildings and generates bounding boxes on the image that are then passed to an LVLM for damage classification and contextual interpretation.<n>We evaluate our framework on two real-world benchmarks: RescueNet and FloodNet.
  arXiv  Detail & Related papers  (2026-08-03T08:39:59Z)
• AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World [75.54693105865003]
  We introduce AerialMetric, a benchmark dataset to evaluate and facilitate the adaptation of monocular metric depth estimation under UAV aerial viewpoints.<n>AerialMetric provides 52K real-world and 16K synthetic image-depth pairs with reliable metric ground truth.
  arXiv  Detail & Related papers  (2026-06-29T02:48:47Z)
• Topology-Informed Neural Networks for Flood Detection in Optical and Synthetic Aperture Radar Imagery [10.268453073867622]
  Rapid and accurate flood detection is crucial for emergency response and timely mitigation of human and economic loss.<n>Many flood events remain challenging to detect because cloud cover obscures optical satellite imagery.<n>We show that topological descriptors carry meaningful flood signals independently and complement existing networks to yield more robust and interpretable flood detection systems.
  arXiv  Detail & Related papers  (2026-06-24T16:52:28Z)
• AnchorD: Metric Grounding of Monocular Depth Using Factor Graphs [16.622717763906262]
  Currently available depth sensors are prone to errors on transparent, specular, and general non-Lambertian surfaces.<n>We propose a training-free depth grounding framework that anchors monocular depth estimation priors from a depth foundation model.<n>Our method performs a patch-wise affine alignment, locally grounding monocular predictions in metric real-world depth.
  arXiv  Detail & Related papers  (2026-05-04T14:48:52Z)
• High Resolution Flood Extent Detection Using Deep Learning with Random Forest Derived Training Labels [0.0]
  High-frequency, high-resolution optical imagery (3 m), such as PlanetScope, offers new opportunities for flood mapping.<n>We develop a framework that integrates PlanetScope optical imagery with topographic features using machine learning (ML) and deep learning (DL) algorithms.
  arXiv  Detail & Related papers  (2026-03-23T19:26:46Z)
• UnLoc: Leveraging Depth Uncertainties for Floorplan Localization [80.55849461031879]
  UnLoc is an efficient data-driven solution for sequential camera localization within floorplans.<n>We introduce a novel probabilistic model that incorporates uncertainty estimation, modeling depth predictions as explicit probability distributions.<n>We evaluate UnLoc on large-scale synthetic and real-world datasets, demonstrating significant improvements in terms of accuracy and robustness.
  arXiv  Detail & Related papers  (2025-09-14T14:45:43Z)
• From Ideal to Real: Unified and Data-Efficient Dense Prediction for Real-World Scenarios [66.57089888022414]
  We introduce DenseWorld, a benchmark spanning a broad set of 25 dense prediction tasks that correspond to urgent real-world applications.<n>We then propose DenseDiT, which exploits generative models' visual priors to perform diverse real-world dense prediction tasks through a unified strategy.<n>DenseDiT achieves superior results using less than 0.01% training data of baselines, underscoring its practical value for real-world deployment.
  arXiv  Detail & Related papers  (2025-06-25T09:40:50Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• TanDepth: Leveraging Global DEMs for Metric Monocular Depth Estimation in UAVs [5.6168844664788855]
  This work presents TanDepth, a practical scale recovery method for obtaining metric depth results from relative estimations at inference-time.<n>Our method leverages sparse measurements from Global Digital Elevation Models (GDEM) by projecting them to the camera view.<n>An adaptation to the Cloth Filter Simulation is presented, which allows selecting ground points from the estimated depth map to then correlate with the projected reference points.
  arXiv  Detail & Related papers  (2024-09-08T15:54:43Z)
• Automated Floodwater Depth Estimation Using Large Multimodal Model for Rapid Flood Mapping [0.0]
  This paper presents an automated and fast approach for estimating floodwater depth from on-site flood photos. A pre-trained large multimodal model, GPT-4 Vision, was used specifically for estimating floodwater. Results show that the proposed approach can rapidly provide a consistent and reliable estimation of floodwater depth from flood photos.
  arXiv  Detail & Related papers  (2024-02-26T16:02:15Z)
• Self-Supervised Learning based Depth Estimation from Monocular Images [0.0]
  The goal of Monocular Depth Estimation is to predict the depth map, given a 2D monocular RGB image as input. We plan to do intrinsic camera parameters during training and apply weather augmentations to further generalize our model.
  arXiv  Detail & Related papers  (2023-04-14T07:14:08Z)
• Do More With What You Have: Transferring Depth-Scale from Labeled to Unlabeled Domains [43.16293941978469]
  Self-supervised depth estimators result in up-to-scale predictions that are linearly correlated to their absolute depth values across the domain. We show that aligning the field-of-view of two datasets prior to training results in a common linear relationship for both domains. We use this observed property to transfer the depth-scale from source datasets that have absolute depth labels to new target datasets that lack these measurements.
  arXiv  Detail & Related papers  (2023-03-14T07:07:34Z)
• An evaluation of deep learning models for predicting water depth evolution in urban floods [59.31940764426359]
  We compare different deep learning models for prediction of water depth at high spatial resolution. Deep learning models are trained to reproduce the data simulated by the CADDIES cellular-automata flood model. Our results show that the deep learning models present in general lower errors compared to the other methods.
  arXiv  Detail & Related papers  (2023-02-20T16:08:54Z)
• Probabilistic and Geometric Depth: Detecting Objects in Perspective [78.00922683083776]
  3D object detection is an important capability needed in various practical applications such as driver assistance systems. Monocular 3D detection, as an economical solution compared to conventional settings relying on binocular vision or LiDAR, has drawn increasing attention recently but still yields unsatisfactory results. This paper first presents a systematic study on this problem and observes that the current monocular 3D detection problem can be simplified as an instance depth estimation problem.
  arXiv  Detail & Related papers  (2021-07-29T16:30:33Z)
• Improving Emergency Response during Hurricane Season using Computer Vision [0.06882042556551608]
  We have developed a framework for crisis response and management that incorporates the latest technologies in computer vision (CV), inland flood prediction, damage assessment and data visualization. Our computer-vision model analyzes spaceborne and airborne imagery to detect relevant features during and after a natural disaster. We have designed an ensemble of models to identify features including water, roads, buildings, and vegetation from the imagery.
  arXiv  Detail & Related papers  (2020-08-17T15:42:02Z)
• Breaking the Limits of Remote Sensing by Simulation and Deep Learning for Flood and Debris Flow Mapping [13.167695669500391]
  We propose a framework that estimates inundation depth and debris-flow-induced topographic deformation from remote sensing imagery. A water and debris flow simulator generates training data for various artificial disaster scenarios. We show that regression models based on Attention U-Net and LinkNet architectures trained on such synthetic data can predict the maximum water level and topographic deformation.
  arXiv  Detail & Related papers  (2020-06-09T10:59:15Z)
• Occlusion-Aware Depth Estimation with Adaptive Normal Constraints [85.44842683936471]
  We present a new learning-based method for multi-frame depth estimation from a color video. Our method outperforms the state-of-the-art in terms of depth estimation accuracy.
  arXiv  Detail & Related papers  (2020-04-02T07:10:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.