Robust Internal Representations for Domain Generalization

• URL: http://arxiv.org/abs/2309.15522v1
• Date: Wed, 27 Sep 2023 09:41:02 GMT
• Title: Robust Internal Representations for Domain Generalization
• Authors: Mohammad Rostami
• Abstract summary: This paper serves as a comprehensive survey of my research in transfer learning by utilizing embedding spaces. My research delves into the various settings of transfer learning, including, few-shot learning, zero-shot learning, continual learning, domain adaptation, and distributed learning.
• Score: 23.871860648919593
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper which is part of the New Faculty Highlights Invited Speaker Program of AAAI'23, serves as a comprehensive survey of my research in transfer learning by utilizing embedding spaces. The work reviewed in this paper specifically revolves around the inherent challenges associated with continual learning and limited availability of labeled data. By providing an overview of my past and ongoing contributions, this paper aims to present a holistic understanding of my research, paving the way for future explorations and advancements in the field. My research delves into the various settings of transfer learning, including, few-shot learning, zero-shot learning, continual learning, domain adaptation, and distributed learning. I hope this survey provides a forward-looking perspective for researchers who would like to focus on similar research directions.

Related papers

• Continual Learning in Medical Imaging: A Survey and Practical Analysis [0.7794090852114541]
  Continual Learning offers promise in enabling the sequential acquisition of new knowledge without forgetting previous learnings in neural networks. We review the recent literature on continual learning in the medical domain, highlight recent trends, and point out the practical issues. We critically discuss the current state of continual learning in medical imaging, including identifying open problems and outlining promising future directions.
  arXiv  Detail & Related papers  (2024-05-22T09:48:04Z)
• Transfer Learning in Human Activity Recognition: A Survey [0.13029741239874087]
  Sensor-based human activity recognition (HAR) has been an active research area, owing to its applications in smart environments, assisted living, fitness, healthcare, etc. Recently, deep learning based end-to-end training has resulted in state-of-the-art performance in domains such as computer vision and natural language. We focus on these transfer learning methods in the application domains of smart home and wearables-based HAR.
  arXiv  Detail & Related papers  (2024-01-18T18:12:35Z)
• Federated Learning for Generalization, Robustness, Fairness: A Survey and Benchmark [55.898771405172155]
  Federated learning has emerged as a promising paradigm for privacy-preserving collaboration among different parties. We provide a systematic overview of the important and recent developments of research on federated learning.
  arXiv  Detail & Related papers  (2023-11-12T06:32:30Z)
• Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future [38.1992191907012]
  Chain-of-thought prompting significantly enhances LLM's reasoning capabilities. This paper systematically investigates relevant research, summarizing advanced methods. We also delve into the current frontiers and delineate the challenges and future directions.
  arXiv  Detail & Related papers  (2023-09-27T04:53:10Z)
• A Comprehensive Survey of Forgetting in Deep Learning Beyond Continual Learning [58.107474025048866]
  Forgetting refers to the loss or deterioration of previously acquired knowledge. Forgetting is a prevalent phenomenon observed in various other research domains within deep learning.
  arXiv  Detail & Related papers  (2023-07-16T16:27:58Z)
• A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontiers [76.51245425667845]
  Relation extraction (RE) involves identifying the relations between entities from underlying content. Deep neural networks have dominated the field of RE and made noticeable progress. This survey is expected to facilitate researchers' collaborative efforts to address the challenges of real-world RE systems.
  arXiv  Detail & Related papers  (2023-06-03T08:39:25Z)
• The Semantic Reader Project: Augmenting Scholarly Documents through AI-Powered Interactive Reading Interfaces [54.2590226904332]
  We describe the Semantic Reader Project, a effort across multiple institutions to explore automatic creation of dynamic reading interfaces for research papers. Ten prototype interfaces have been developed and more than 300 participants and real-world users have shown improved reading experiences. We structure this paper around challenges scholars and the public face when reading research papers.
  arXiv  Detail & Related papers  (2023-03-25T02:47:09Z)
• Parsing Objects at a Finer Granularity: A Survey [54.72819146263311]
  Fine-grained visual parsing is important in many real-world applications, e.g., agriculture, remote sensing, and space technologies. Predominant research efforts tackle these fine-grained sub-tasks following different paradigms. We conduct an in-depth study of the advanced work from a new perspective of learning the part relationship.
  arXiv  Detail & Related papers  (2022-12-28T04:20:10Z)
• A Survey of Embedding Space Alignment Methods for Language and Knowledge Graphs [77.34726150561087]
  We survey the current research landscape on word, sentence and knowledge graph embedding algorithms. We provide a classification of the relevant alignment techniques and discuss benchmark datasets used in this field of research.
  arXiv  Detail & Related papers  (2020-10-26T16:08:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.