Lake Ice Monitoring with Webcams and Crowd-Sourced Images

• URL: http://arxiv.org/abs/2002.07875v2
• Date: Fri, 8 May 2020 03:02:35 GMT
• Title: Lake Ice Monitoring with Webcams and Crowd-Sourced Images
• Authors: Rajanie Prabha, Manu Tom, Mathias Rothermel, Emmanuel Baltsavias, Laura Leal-Taixe, Konrad Schindler
• Abstract summary: This paper moves towards a universal model for monitoring lake ice with freely available webcam data. We demonstrate good performance, including the ability to generalise annotations across different winters and different lakes. We introduce a new benchmark dataset of webcam images, Photi-LakeIce, from multiple cameras and two different winters, along with pixel-wise ground truth.
• Score: 15.616179111087053
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Lake ice is a strong climate indicator and has been recognised as part of the Essential Climate Variables (ECV) by the Global Climate Observing System (GCOS). The dynamics of freezing and thawing, and possible shifts of freezing patterns over time, can help in understanding the local and global climate systems. One way to acquire the spatio-temporal information about lake ice formation, independent of clouds, is to analyse webcam images. This paper intends to move towards a universal model for monitoring lake ice with freely available webcam data. We demonstrate good performance, including the ability to generalise across different winters and different lakes, with a state-of-the-art Convolutional Neural Network (CNN) model for semantic image segmentation, Deeplab v3+. Moreover, we design a variant of that model, termed Deep-U-Lab, which predicts sharper, more correct segmentation boundaries. We have tested the model's ability to generalise with data from multiple camera views and two different winters. On average, it achieves intersection-over-union (IoU) values of ~71% across different cameras and ~69% across different winters, greatly outperforming prior work. Going even further, we show that the model even achieves 60% IoU on arbitrary images scraped from photo-sharing web sites. As part of the work, we introduce a new benchmark dataset of webcam images, Photi-LakeIce, from multiple cameras and two different winters, along with pixel-wise ground truth annotations.

Related papers

• Redundancy-Aware Camera Selection for Indoor Scene Neural Rendering [54.468355408388675]
  We build a similarity matrix that incorporates both the spatial diversity of the cameras and the semantic variation of the images. We apply a diversity-based sampling algorithm to optimize the camera selection. We also develop a new dataset, IndoorTraj, which includes long and complex camera movements captured by humans in virtual indoor environments.
  arXiv  Detail & Related papers  (2024-09-11T08:36:49Z)
• Towards Viewpoint Robustness in Bird's Eye View Segmentation [85.99907496019972]
  We study how AV perception models are affected by changes in camera viewpoint. Small changes to pitch, yaw, depth, or height of the camera at inference time lead to large drops in performance. We introduce a technique for novel view synthesis and use it to transform collected data to the viewpoint of target rigs.
  arXiv  Detail & Related papers  (2023-09-11T02:10:07Z)
• The Change You Want to See (Now in 3D) [65.61789642291636]
  The goal of this paper is to detect what has changed, if anything, between two "in the wild" images of the same 3D scene. We contribute a change detection model that is trained entirely on synthetic data and is class-agnostic. We release a new evaluation dataset consisting of real-world image pairs with human-annotated differences.
  arXiv  Detail & Related papers  (2023-08-21T01:59:45Z)
• AMD-HookNet for Glacier Front Segmentation [17.60067480799222]
  knowledge on changes in glacier calving front positions is important for assessing the status of glaciers. Deep learning-based methods have shown great potential for glacier calving front delineation from optical and radar satellite imagery. We propose Attention-Multi-hooking-Deep-supervision HookNet (AMD-HookNet), a novel glacier calving front segmentation framework.
  arXiv  Detail & Related papers  (2023-02-06T12:39:40Z)
• Could Giant Pretrained Image Models Extract Universal Representations? [94.97056702288317]
  We present a study of frozen pretrained models when applied to diverse and representative computer vision tasks. Our work answers the questions of what pretraining task fits best with this frozen setting, how to make the frozen setting more flexible to various downstream tasks, and the effect of larger model sizes.
  arXiv  Detail & Related papers  (2022-11-03T17:57:10Z)
• SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation [101.55622133406446]
  We propose a SurroundDepth method to incorporate the information from multiple surrounding views to predict depth maps across cameras. Specifically, we employ a joint network to process all the surrounding views and propose a cross-view transformer to effectively fuse the information from multiple views. In experiments, our method achieves the state-of-the-art performance on the challenging multi-camera depth estimation datasets.
  arXiv  Detail & Related papers  (2022-04-07T17:58:47Z)
• Learning a Sensor-invariant Embedding of Satellite Data: A Case Study for Lake Ice Monitoring [19.72060218456938]
  We learn a joint, sensor-invariant embedding within a deep neural network. Our application problem is the monitoring of lake ice on Alpine lakes. By fusing satellite data, we map lake ice at a temporal resolution of 1.5 days.
  arXiv  Detail & Related papers  (2021-07-19T18:11:55Z)
• Recent Ice Trends in Swiss Mountain Lakes: 20-year Analysis of MODIS Imagery [19.72060218456938]
  Depleting lake ice can serve as an indicator for climate change, just like sea level rise or glacial retreat. Several Lake Ice Phenological (LIP) events serve as sentinels to understand the regional and global climate change. We focus on observing the LIP events such as freeze-up, break-up and temporal freeze extent in the Oberengadin region of Switzerland.
  arXiv  Detail & Related papers  (2021-03-23T10:25:02Z)
• Ice Monitoring in Swiss Lakes from Optical Satellites and Webcams using Machine Learning [16.71718177904522]
  Multi-temporal satellite images publicly available webcam images are among a viable data sources to monitor lake ice. In this work we investigate machine learning-based image analysis as a tool to determine the extent of ice on Swiss Alpine lakes. We model lake ice monitoring as a pixel-wise semantic segmentation problem, i.e., each pixel on the lake surface is classified to obtain a spatially explicit map of ice cover.
  arXiv  Detail & Related papers  (2020-10-27T14:02:00Z)
• Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3D [100.93808824091258]
  We propose a new end-to-end architecture that directly extracts a bird's-eye-view representation of a scene given image data from an arbitrary number of cameras. Our approach is to "lift" each image individually into a frustum of features for each camera, then "splat" all frustums into a bird's-eye-view grid. We show that the representations inferred by our model enable interpretable end-to-end motion planning by "shooting" template trajectories into a bird's-eye-view cost map output by our network.
  arXiv  Detail & Related papers  (2020-08-13T06:29:01Z)
• Lake Ice Detection from Sentinel-1 SAR with Deep Learning [15.493845481313924]
  We present a lake ice monitoring system based on the automatic analysis of Sentinel-1 Synthetic Aperture Radar (SAR) data with a deep neural network. We cast ice detection as a two class (frozen, non-frozen) semantic problem and solve it using a state-of-the-art deep convolutional network (CNN) We report results on two winters 2016 - 17 and 2017 - 18 and three alpine lakes in Switzerland.
  arXiv  Detail & Related papers  (2020-02-17T16:31:41Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.