Self-supervised Learning for Astronomical Image Classification

• URL: http://arxiv.org/abs/2004.11336v2
• Date: Thu, 25 Jun 2020 13:49:19 GMT
• Title: Self-supervised Learning for Astronomical Image Classification
• Authors: Ana Martinazzo, Mateus Espadoto, Nina S. T. Hirata
• Abstract summary: In Astronomy, a huge amount of image data is generated daily by photometric surveys. We propose a technique to leverage unlabeled astronomical images to pre-train deep convolutional neural networks.
• Score: 1.2891210250935146
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In Astronomy, a huge amount of image data is generated daily by photometric surveys, which scan the sky to collect data from stars, galaxies and other celestial objects. In this paper, we propose a technique to leverage unlabeled astronomical images to pre-train deep convolutional neural networks, in order to learn a domain-specific feature extractor which improves the results of machine learning techniques in setups with small amounts of labeled data available. We show that our technique produces results which are in many cases better than using ImageNet pre-training.

Related papers

• SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentation [69.42764583465508]
  We explore the potential of generative image diffusion to address the scarcity of annotated data in earth observation tasks. To the best of our knowledge, we are the first to generate both images and corresponding masks for satellite segmentation.
  arXiv  Detail & Related papers  (2024-03-25T10:30:22Z)
• Rethinking Transformers Pre-training for Multi-Spectral Satellite Imagery [78.43828998065071]
  Recent advances in unsupervised learning have demonstrated the ability of large vision models to achieve promising results on downstream tasks. Such pre-training techniques have also been explored recently in the remote sensing domain due to the availability of large amount of unlabelled data. In this paper, we re-visit transformers pre-training and leverage multi-scale information that is effectively utilized with multiple modalities.
  arXiv  Detail & Related papers  (2024-03-08T16:18:04Z)
• Astronomical Images Quality Assessment with Automated Machine Learning [0.0]
  Electronically Assisted Astronomy consists of capturing deep sky images with a digital camera coupled to a telescope to display views of celestial objects that would have been invisible through direct observation. This practice generates a large quantity of data, which may then be enhanced with dedicated image editing software after observation sessions. In this study, we show how Image Quality Assessment can be useful for automatically rating astronomical images, and we also develop a dedicated model by using Automated Machine Learning.
  arXiv  Detail & Related papers  (2023-11-17T16:14:11Z)
• Image Restoration with Point Spread Function Regularization and Active Learning [5.575847437953924]
  Large-scale astronomical surveys can capture numerous images of celestial objects, including galaxies and nebulae. varying noise levels and point spread functions can hamper the accuracy and efficiency of information extraction from these images. We propose a novel image restoration algorithm that connects a deep learning-based restoration algorithm with a high-fidelity telescope simulator.
  arXiv  Detail & Related papers  (2023-10-31T23:16:26Z)
• CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representations [90.50864830038202]
  We present Contrastive Spatial Pre-Training (CSP), a self-supervised learning framework for geo-tagged images. We use a dual-encoder to separately encode the images and their corresponding geo-locations, and use contrastive objectives to learn effective location representations from images. CSP significantly boosts the model performance with 10-34% relative improvement with various labeled training data sampling ratios.
  arXiv  Detail & Related papers  (2023-05-01T23:11:18Z)
• Self Supervised Learning for Few Shot Hyperspectral Image Classification [57.2348804884321]
  We propose to leverage Self Supervised Learning (SSL) for HSI classification. We show that by pre-training an encoder on unlabeled pixels using Barlow-Twins, a state-of-the-art SSL algorithm, we can obtain accurate models with a handful of labels.
  arXiv  Detail & Related papers  (2022-06-24T07:21:53Z)
• The Intrinsic Dimension of Images and Its Impact on Learning [60.811039723427676]
  It is widely believed that natural image data exhibits low-dimensional structure despite the high dimensionality of conventional pixel representations. In this work, we apply dimension estimation tools to popular datasets and investigate the role of low-dimensional structure in deep learning.
  arXiv  Detail & Related papers  (2021-04-18T16:29:23Z)
• Data Augmentation for Object Detection via Differentiable Neural Rendering [71.00447761415388]
  It is challenging to train a robust object detector when annotated data is scarce. Existing approaches to tackle this problem include semi-supervised learning that interpolates labeled data from unlabeled data. We introduce an offline data augmentation method for object detection, which semantically interpolates the training data with novel views.
  arXiv  Detail & Related papers  (2021-03-04T06:31:06Z)
• Self-Supervised Representation Learning for Astronomical Images [1.0499611180329804]
  Self-supervised learning recovers representations of sky survey images that are semantically useful. We show that our approach can achieve the accuracy of supervised models while using 2-4 times fewer labels for training.
  arXiv  Detail & Related papers  (2020-12-24T03:25:36Z)
• Data--driven Image Restoration with Option--driven Learning for Big and Small Astronomical Image Datasets [11.96518190758417]
  We propose a new data-driven image restoration method based on generative adversarial networks with option-driven learning. Our method can obtain very stable image restoration results, regardless of the number of reference images.
  arXiv  Detail & Related papers  (2020-11-07T05:05:55Z)
• Detection of asteroid trails in Hubble Space Telescope images using Deep Learning [0.0]
  We present an application of Deep Learning for the image recognition of asteroid trails in single-exposure photos taken by the Hubble Space Telescope. Using algorithms based on multi-layered deep Convolutional Neural Networks, we report accuracies of above 80% on the validation set.
  arXiv  Detail & Related papers  (2020-10-29T09:03:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.