Unlocking large-scale crop field delineation in smallholder farming systems with transfer learning and weak supervision

• URL: http://arxiv.org/abs/2201.04771v1
• Date: Thu, 13 Jan 2022 03:01:06 GMT
• Title: Unlocking large-scale crop field delineation in smallholder farming systems with transfer learning and weak supervision
• Authors: Sherrie Wang, Francois Waldner, David B. Lobell
• Abstract summary: Crop field boundaries aid in mapping crop types, predicting yields, and delivering field-scale analytics to farmers. Recent years have seen the successful application of deep learning to delineating field boundaries in industrial agricultural systems. We demonstrate the methods' success in India where we efficiently generated 10,000 new field labels.
• Score: 14.98900824231117
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Crop field boundaries aid in mapping crop types, predicting yields, and delivering field-scale analytics to farmers. Recent years have seen the successful application of deep learning to delineating field boundaries in industrial agricultural systems, but field boundary datasets remain missing in smallholder systems due to (1) small fields that require high resolution satellite imagery to delineate and (2) a lack of ground labels for model training and validation. In this work, we combine transfer learning and weak supervision to overcome these challenges, and we demonstrate the methods' success in India where we efficiently generated 10,000 new field labels. Our best model uses 1.5m resolution Airbus SPOT imagery as input, pre-trains a state-of-the-art neural network on France field boundaries, and fine-tunes on India labels to achieve a median Intersection over Union (IoU) of 0.86 in India. If using 4.8m resolution PlanetScope imagery instead, the best model achieves a median IoU of 0.72. Experiments also show that pre-training in France reduces the number of India field labels needed to achieve a given performance level by as much as $20\times$ when datasets are small. These findings suggest our method is a scalable approach for delineating crop fields in regions of the world that currently lack field boundary datasets. We publicly release the 10,000 labels and delineation model to facilitate the creation of field boundary maps and new methods by the community.

Related papers

• Delineate Anything: Resolution-Agnostic Field Boundary Delineation on Satellite Imagery [0.0]
  We introduce the Field Boundary Instance - 22M dataset (FBIS-22M), a large-scale, multi-resolution instance dataset. We propose Delineate Anything, an instance segmentation model trained on the FBIS-22M dataset. Our proposed model sets a new state-of-the-art, achieving a substantial improvement of 88.5% in mAP@0.5 and 103% in mAP@0.5:0.95 over existing methods.
  arXiv  Detail & Related papers  (2025-04-03T12:37:04Z)
• Fields of The World: A Machine Learning Benchmark Dataset For Global Agricultural Field Boundary Segmentation [12.039406240082515]
  Fields of The World (FTW) is a novel benchmark dataset for agricultural field instance segmentation. FTW is an order of magnitude larger than previous datasets with 70,462 samples. We show that models trained on FTW have better zero-shot and fine-tuning performance in held-out countries.
  arXiv  Detail & Related papers  (2024-09-24T17:20:58Z)
• Multi-Region Transfer Learning for Segmentation of Crop Field Boundaries in Satellite Images with Limited Labels [6.79949280366368]
  We present an approach for segmentation of crop field boundaries in satellite images in regions lacking labeled data. We show that our approach outperforms existing methods and that multi-region transfer learning substantially boosts performance for multiple model architectures.
  arXiv  Detail & Related papers  (2024-03-29T22:24:12Z)
• Taking it further: leveraging pseudo labels for field delineation across label-scarce smallholder regions [2.8120847363433654]
  This study explores opportunities of using sparse field delineation pseudo labels for fine-tuning models across geographies and sensor characteristics. We build on a FracTAL ResUNet trained for crop field delineation in India (median field size of 0.24 ha) and use this pre-trained model to generate pseudo labels in Mozambique. We then used the human-annotated labels and the pseudo labels for model fine-tuning and compared predictions against human field annotations.
  arXiv  Detail & Related papers  (2023-12-12T08:39:07Z)
• Optimization Efficient Open-World Visual Region Recognition [55.76437190434433]
  RegionSpot integrates position-aware localization knowledge from a localization foundation model with semantic information from a ViL model. Experiments in open-world object recognition show that our RegionSpot achieves significant performance gain over prior alternatives.
  arXiv  Detail & Related papers  (2023-11-02T16:31:49Z)
• HarvestNet: A Dataset for Detecting Smallholder Farming Activity Using Harvest Piles and Remote Sensing [50.4506590177605]
  HarvestNet is a dataset for mapping the presence of farms in the Ethiopian regions of Tigray and Amhara during 2020-2023. We introduce a new approach based on the detection of harvest piles characteristic of many smallholder systems. We conclude that remote sensing of harvest piles can contribute to more timely and accurate cropland assessments in food insecure regions.
  arXiv  Detail & Related papers  (2023-08-23T11:03:28Z)
• Using Machine Learning to generate an open-access cropland map from satellite images time series in the Indian Himalayan Region [0.28675177318965034]
  We develop an ML pipeline that relies on Sentinel-2 satellite images time series. We generate a cropland map for three districts of Himachal Pradesh, spanning 14,600 km2, which improves the resolution and quality of existing public maps.
  arXiv  Detail & Related papers  (2022-03-28T12:08:06Z)
• Jalisco's multiclass land cover analysis and classification using a novel lightweight convnet with real-world multispectral and relief data [51.715517570634994]
  We present our novel lightweight (only 89k parameters) Convolution Neural Network (ConvNet) to make LC classification and analysis. In this work, we combine three real-world open data sources to obtain 13 channels. Our embedded analysis anticipates the limited performance in some classes and gives us the opportunity to group the most similar.
  arXiv  Detail & Related papers  (2022-01-26T14:58:51Z)
• Streaming Self-Training via Domain-Agnostic Unlabeled Images [62.57647373581592]
  We present streaming self-training (SST) that aims to democratize the process of learning visual recognition models. Key to SST are two crucial observations: (1) domain-agnostic unlabeled images enable us to learn better models with a few labeled examples without any additional knowledge or supervision; and (2) learning is a continuous process and can be done by constructing a schedule of learning updates.
  arXiv  Detail & Related papers  (2021-04-07T17:58:39Z)
• Semi-Supervised Semantic Segmentation in Earth Observation: The MiniFrance Suite, Dataset Analysis and Multi-task Network Study [82.02173199363571]
  We introduce a novel large-scale dataset for semi-supervised semantic segmentation in Earth Observation, the MiniFrance suite. MiniFrance has several unprecedented properties: it is large-scale, containing over 2000 very high resolution aerial images, accounting for more than 200 billions samples (pixels) We present tools for data representativeness analysis in terms of appearance similarity and a thorough study of MiniFrance data, demonstrating that it is suitable for learning and generalizes well in a semi-supervised setting.
  arXiv  Detail & Related papers  (2020-10-15T15:36:58Z)
• Small, Sparse, but Substantial: Techniques for Segmenting Small Agricultural Fields Using Sparse Ground Data [4.850320383827591]
  We present a multi-stage approach that uses a combination of machine learning and image processing techniques. In an evaluation using high-resolution imagery, we show that our approach has a high F-Score of 0.84 in areas with large fields and reasonable accuracy with an F-Score of 0.73 in areas with small fields.
  arXiv  Detail & Related papers  (2020-05-05T05:26:19Z)
• Agriculture-Vision: A Large Aerial Image Database for Agricultural Pattern Analysis [110.30849704592592]
  We present Agriculture-Vision: a large-scale aerial farmland image dataset for semantic segmentation of agricultural patterns. Each image consists of RGB and Near-infrared (NIR) channels with resolution as high as 10 cm per pixel. We annotate nine types of field anomaly patterns that are most important to farmers.
  arXiv  Detail & Related papers  (2020-01-05T20:19:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.