Urban feature analysis from aerial remote sensing imagery using self-supervised and semi-supervised computer vision

• URL: http://arxiv.org/abs/2208.08047v1
• Date: Wed, 17 Aug 2022 03:41:56 GMT
• Title: Urban feature analysis from aerial remote sensing imagery using self-supervised and semi-supervised computer vision
• Authors: Sachith Seneviratne, Jasper S. Wijnands, Kerry Nice, Haifeng Zhao, Branislava Godic, Suzanne Mavoa, Rajith Vidanaarachchi, Mark Stevenson, Leandro Garcia, Ruth F. Hunter and Jason Thompson
• Abstract summary: Analysis of overhead imagery using computer vision is a problem that has received considerable attention in academic literature. These problems are addressed here through the development of a more generic framework, incorporating advances in representation learning. The successful low-level detection of urban infrastructure evolution over a 10-year period from 60 million unlabeled images, exemplifies the substantial potential of our approach to advance quantitative urban research.
• Score: 8.124947412639704
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Analysis of overhead imagery using computer vision is a problem that has received considerable attention in academic literature. Most techniques that operate in this space are both highly specialised and require expensive manual annotation of large datasets. These problems are addressed here through the development of a more generic framework, incorporating advances in representation learning which allows for more flexibility in analysing new categories of imagery with limited labeled data. First, a robust representation of an unlabeled aerial imagery dataset was created based on the momentum contrast mechanism. This was subsequently specialised for different tasks by building accurate classifiers with as few as 200 labeled images. The successful low-level detection of urban infrastructure evolution over a 10-year period from 60 million unlabeled images, exemplifies the substantial potential of our approach to advance quantitative urban research.

Related papers

• Free-ATM: Exploring Unsupervised Learning on Diffusion-Generated Images with Free Attention Masks [64.67735676127208]
  Text-to-image diffusion models have shown great potential for benefiting image recognition. Although promising, there has been inadequate exploration dedicated to unsupervised learning on diffusion-generated images. We introduce customized solutions by fully exploiting the aforementioned free attention masks.
  arXiv  Detail & Related papers  (2023-08-13T10:07:46Z)
• Domain Generalization for Mammographic Image Analysis with Contrastive Learning [62.25104935889111]
  The training of an efficacious deep learning model requires large data with diverse styles and qualities. A novel contrastive learning is developed to equip the deep learning models with better style generalization capability. The proposed method has been evaluated extensively and rigorously with mammograms from various vendor style domains and several public datasets.
  arXiv  Detail & Related papers  (2023-04-20T11:40:21Z)
• Expanding Accurate Person Recognition to New Altitudes and Ranges: The BRIAR Dataset [1.965868228519436]
  Face recognition technology has advanced significantly in recent years due largely to the availability of large and increasingly complex training datasets for use in deep learning models. These datasets, however, have limited utility in more advanced security, forensics, and military applications. This paper describes methods used to collect and curate the dataset, and the dataset's characteristics at the current stage.
  arXiv  Detail & Related papers  (2022-11-03T15:51:39Z)
• Self-Supervised Pretraining on Satellite Imagery: a Case Study on Label-Efficient Vehicle Detection [0.0]
  We study in-domain self-supervised representation learning for object detection on very high resolution optical satellite imagery. We use the large land use classification dataset Functional Map of the World to pretrain representations with an extension of the Momentum Contrast framework. We then investigate this model's transferability on a real-world task of fine-grained vehicle detection and classification on Preligens proprietary data.
  arXiv  Detail & Related papers  (2022-10-21T08:41:22Z)
• Automatic Image Content Extraction: Operationalizing Machine Learning in Humanistic Photographic Studies of Large Visual Archives [81.88384269259706]
  We introduce Automatic Image Content Extraction framework for machine learning-based search and analysis of large image archives. The proposed framework can be applied in several domains in humanities and social sciences.
  arXiv  Detail & Related papers  (2022-04-05T12:19:24Z)
• Self-Supervision, Remote Sensing and Abstraction: Representation Learning Across 3 Million Locations [7.860343491689477]
  We show that self-supervised methods can build a generalizable representation from as few as 200 cities. We also find that the performance discrepancy of such methods, when compared to supervised methods, is significant for remote sensing imagery.
  arXiv  Detail & Related papers  (2022-03-08T23:32:33Z)
• Region-level Active Learning for Cluttered Scenes [60.93811392293329]
  We introduce a new strategy that subsumes previous Image-level and Object-level approaches into a generalized, Region-level approach. We show that this approach significantly decreases labeling effort and improves rare object search on realistic data with inherent class-imbalance and cluttered scenes.
  arXiv  Detail & Related papers  (2021-08-20T14:02:38Z)
• Artificial Perceptual Learning: Image Categorization with Weak Supervision [2.6774008509840996]
  We propose a novel machine learning framework, artificial learning (APL), to tackle the problem of weakly supervised image categorization. APL is constructed using state-of-the-art machine learning algorithms as building blocks to mimic the cognitive development process known as infant categorization. We validate the proposed framework using a small set of images with high quality human annotations and show that the proposed framework attains human-level cognitive economy.
  arXiv  Detail & Related papers  (2021-06-02T21:12:20Z)
• Advances in Deep Learning for Hyperspectral Image Analysis--Addressing Challenges Arising in Practical Imaging Scenarios [7.41157183358269]
  We will review advances in the community that leverage deep learning for robust hyperspectral image analysis. challenges include limited ground truth and high dimensional nature of the data. Specifically, we will review unsupervised, semi-supervised and active learning approaches to image analysis.
  arXiv  Detail & Related papers  (2020-07-16T19:51:02Z)
• Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation [57.68890534164427]
  In this work, we ask if we may leverage semi-supervised learning in unlabeled video sequences and extra images to improve the performance on urban scene segmentation. We simply predict pseudo-labels for the unlabeled data and train subsequent models with both human-annotated and pseudo-labeled data. Our Naive-Student model, trained with such simple yet effective iterative semi-supervised learning, attains state-of-the-art results at all three Cityscapes benchmarks.
  arXiv  Detail & Related papers  (2020-05-20T18:00:05Z)
• Image Segmentation Using Deep Learning: A Survey [58.37211170954998]
  Image segmentation is a key topic in image processing and computer vision. There has been a substantial amount of works aimed at developing image segmentation approaches using deep learning models.
  arXiv  Detail & Related papers  (2020-01-15T21:37:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.