Multiple Random Masking Autoencoder Ensembles for Robust Multimodal Semi-supervised Learning

• URL: http://arxiv.org/abs/2402.08035v1
• Date: Mon, 12 Feb 2024 20:08:58 GMT
• Title: Multiple Random Masking Autoencoder Ensembles for Robust Multimodal Semi-supervised Learning
• Authors: Alexandru-Raul Todoran, Marius Leordeanu
• Abstract summary: There is an increasing number of real-world problems in computer vision and machine learning. In the case of Earth Observations from satellite data, it is important to be able to predict one observation layer.
• Score: 64.81450582542878
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: There is an increasing number of real-world problems in computer vision and machine learning requiring to take into consideration multiple interpretation layers (modalities or views) of the world and learn how they relate to each other. For example, in the case of Earth Observations from satellite data, it is important to be able to predict one observation layer (e.g. vegetation index) from other layers (e.g. water vapor, snow cover, temperature etc), in order to best understand how the Earth System functions and also be able to reliably predict information for one layer when the data is missing (e.g. due to measurement failure or error).

Related papers

• Investigating the Capabilities of Deep Learning for Processing and Interpreting One-Shot Multi-offset GPR Data: A Numerical Case Study for Lunar and Martian Environments [9.150932930653921]
  Ground-penetrating radar (GPR) is a mature geophysical method that has gained increasing popularity in planetary science over the past decade. GPR has been utilised both for Lunar and Martian missions providing pivotal information regarding the near surface geology of Terrestrial planets. This paper investigates the potential of deep learning for interpreting and processing GPR data.
  arXiv  Detail & Related papers  (2024-10-18T11:38:29Z)
• Global atmospheric data assimilation with multi-modal masked autoencoders [20.776143147372427]
  "EarthNet" is a multi-modal foundation model for data assimilation. It learns to predict a global gap-filled atmospheric state solely from satellite observations. It produces a global 0.16 degree reanalysis dataset of 3D atmospheric temperature and humidity.
  arXiv  Detail & Related papers  (2024-07-16T13:15:51Z)
• URLOST: Unsupervised Representation Learning without Stationarity or Topology [26.17135629579595]
  We introduce a novel framework that learns from high-dimensional data lacking stationarity and topology. Our model combines a learnable self-organizing layer, density adjusted spectral clustering, and masked autoencoders. We evaluate its effectiveness on simulated biological vision data, neural recordings from the primary visual cortex, and gene expression datasets.
  arXiv  Detail & Related papers  (2023-10-06T18:00:02Z)
• Multi-Task Hypergraphs for Semi-supervised Learning using Earth Observations [51.344339837501835]
  We introduce a powerful multi-task hypergraph, in which every node is a task and different paths through the hypergraph reaching a given task become unsupervised teachers. We apply our model to one of the most important problems of our times, that of Earth Observation, which is highly multi-task and it often suffers from missing ground-truth data. We show that the hypergraph can adapt unsupervised to gradual data distribution shifts and reliably recover, through its multi-task self-supervision process.
  arXiv  Detail & Related papers  (2023-08-21T20:22:51Z)
• Semi-Supervised Domain Adaptation for Cross-Survey Galaxy Morphology Classification and Anomaly Detection [57.85347204640585]
  We develop a Universal Domain Adaptation method DeepAstroUDA. It can be applied to datasets with different types of class overlap. For the first time, we demonstrate the successful use of domain adaptation on two very different observational datasets.
  arXiv  Detail & Related papers  (2022-11-01T18:07:21Z)
• AutoGeoLabel: Automated Label Generation for Geospatial Machine Learning [69.47585818994959]
  We evaluate a big data processing pipeline to auto-generate labels for remote sensing data. We utilize the big geo-data platform IBM PAIRS to dynamically generate such labels in dense urban areas.
  arXiv  Detail & Related papers  (2022-01-31T20:02:22Z)
• Deep Learning Through the Lens of Example Difficulty [21.522182447513632]
  We introduce a measure of the computational difficulty of making a prediction for a given input: the (effective) prediction depth. Our investigation reveals surprising yet simple relationships between the prediction depth of a given input and the model's uncertainty, confidence, accuracy and speed of learning for that data point.
  arXiv  Detail & Related papers  (2021-06-17T16:48:12Z)
• Campus3D: A Photogrammetry Point Cloud Benchmark for Hierarchical Understanding of Outdoor Scene [76.4183572058063]
  We present a richly-annotated 3D point cloud dataset for multiple outdoor scene understanding tasks. The dataset has been point-wisely annotated with both hierarchical and instance-based labels. We formulate a hierarchical learning problem for 3D point cloud segmentation and propose a measurement evaluating consistency across various hierarchies.
  arXiv  Detail & Related papers  (2020-08-11T19:10:32Z)
• Laplacian Denoising Autoencoder [114.21219514831343]
  We propose to learn data representations with a novel type of denoising autoencoder. The noisy input data is generated by corrupting latent clean data in the gradient domain. Experiments on several visual benchmarks demonstrate that better representations can be learned with the proposed approach.
  arXiv  Detail & Related papers  (2020-03-30T16:52:39Z)
• Intelligence, physics and information -- the tradeoff between accuracy and simplicity in machine learning [5.584060970507507]
  I believe viewing intelligence in terms of many integral aspects, and a universal two-term tradeoff between task performance and complexity, provides two feasible perspectives. In this thesis, I address several key questions in some aspects of intelligence, and study the phase transitions in the two-term tradeoff.
  arXiv  Detail & Related papers  (2020-01-11T18:34:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.