A Survey on Deep Semi-supervised Learning
- URL: http://arxiv.org/abs/2103.00550v1
- Date: Sun, 28 Feb 2021 16:22:58 GMT
- Title: A Survey on Deep Semi-supervised Learning
- Authors: Xiangli Yang, Zixing Song, Irwin King, Zenglin Xu
- Abstract summary: We first present a taxonomy for deep semi-supervised learning that categorizes existing methods.
We then offer a detailed comparison of these methods in terms of the type of losses, contributions, and architecture differences.
- Score: 51.26862262550445
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Deep semi-supervised learning is a fast-growing field with a range of
practical applications. This paper provides a comprehensive survey on both
fundamentals and recent advances in deep semi-supervised learning methods from
model design perspectives and unsupervised loss functions. We first present a
taxonomy for deep semi-supervised learning that categorizes existing methods,
including deep generative methods, consistency regularization methods,
graph-based methods, pseudo-labeling methods, and hybrid methods. Then we offer
a detailed comparison of these methods in terms of the type of losses,
contributions, and architecture differences. In addition to the past few years'
progress, we further discuss some shortcomings of existing methods and provide
some tentative heuristic solutions for solving these open problems.
Related papers
- Exploiting Fine-Grained Prototype Distribution for Boosting Unsupervised Class Incremental Learning [13.17775851211893]
This paper explores a more challenging problem of unsupervised class incremental learning (UCIL)
The essence of addressing this problem lies in effectively capturing comprehensive feature representations and discovering unknown novel classes.
We propose a strategy to minimize overlap between novel and existing classes, thereby preserving historical knowledge and mitigating the phenomenon of catastrophic forgetting.
arXiv Detail & Related papers (2024-08-19T14:38:27Z) - Better Understanding Differences in Attribution Methods via Systematic Evaluations [57.35035463793008]
Post-hoc attribution methods have been proposed to identify image regions most influential to the models' decisions.
We propose three novel evaluation schemes to more reliably measure the faithfulness of those methods.
We use these evaluation schemes to study strengths and shortcomings of some widely used attribution methods over a wide range of models.
arXiv Detail & Related papers (2023-03-21T14:24:58Z) - Guided Depth Map Super-resolution: A Survey [88.54731860957804]
Guided depth map super-resolution (GDSR) aims to reconstruct a high-resolution (HR) depth map from a low-resolution (LR) observation with the help of a paired HR color image.
A myriad of novel and effective approaches have been proposed recently, especially with powerful deep learning techniques.
This survey is an effort to present a comprehensive survey of recent progress in GDSR.
arXiv Detail & Related papers (2023-02-19T15:43:54Z) - Surface Reconstruction from Point Clouds: A Survey and a Benchmark [34.78096555134551]
This paper aims to review and benchmark existing methods in the new era of deep learning surface reconstruction.
We contribute a large-scale benchmarking dataset consisting of both synthetic and real-scanned data.
We study how different methods generalize in terms of reconstructing complex surface shapes.
arXiv Detail & Related papers (2022-05-05T03:02:57Z) - A Review of Landcover Classification with Very-High Resolution Remotely
Sensed Optical Images-Analysis Unit,Model Scalability and Transferability [4.704131850850489]
Landcover classification remains one of the most challenging tasks in very-high-resolution (VHR) image analysis.
As the rapidly increasing number of Deep Learning (DL) based landcover methods and training strategies are claimed to be the state-of-the-art, the already fragmented technical landscape of landcover mapping methods has been further complicated.
arXiv Detail & Related papers (2022-02-07T16:38:40Z) - A Unifying Review of Deep and Shallow Anomaly Detection [38.202998314502786]
We aim to identify the common underlying principles as well as the assumptions that are often made implicitly by various methods.
We provide an empirical assessment of major existing methods that is enriched by the use of recent explainability techniques.
We outline critical open challenges and identify specific paths for future research in anomaly detection.
arXiv Detail & Related papers (2020-09-24T14:47:54Z) - Reinforcement Learning as Iterative and Amortised Inference [62.997667081978825]
We use the control as inference framework to outline a novel classification scheme based on amortised and iterative inference.
We show that taking this perspective allows us to identify parts of the algorithmic design space which have been relatively unexplored.
arXiv Detail & Related papers (2020-06-13T16:10:03Z) - There and Back Again: Revisiting Backpropagation Saliency Methods [87.40330595283969]
Saliency methods seek to explain the predictions of a model by producing an importance map across each input sample.
A popular class of such methods is based on backpropagating a signal and analyzing the resulting gradient.
We propose a single framework under which several such methods can be unified.
arXiv Detail & Related papers (2020-04-06T17:58:08Z) - Disentangling Adaptive Gradient Methods from Learning Rates [65.0397050979662]
We take a deeper look at how adaptive gradient methods interact with the learning rate schedule.
We introduce a "grafting" experiment which decouples an update's magnitude from its direction.
We present some empirical and theoretical retrospectives on the generalization of adaptive gradient methods.
arXiv Detail & Related papers (2020-02-26T21:42:49Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.