Perspectives on the State and Future of Deep Learning -- 2023

• URL: http://arxiv.org/abs/2312.09323v3
• Date: Tue, 19 Dec 2023 04:31:21 GMT
• Title: Perspectives on the State and Future of Deep Learning -- 2023
• Authors: Micah Goldblum, Anima Anandkumar, Richard Baraniuk, Tom Goldstein, Kyunghyun Cho, Zachary C Lipton, Melanie Mitchell, Preetum Nakkiran, Max Welling, Andrew Gordon Wilson
• Abstract summary: The goal of this series is to chronicle opinions and issues in the field of machine learning as they stand today and as they change over time. The plan is to host this survey periodically until the AI singularity paperclip-frenzy-driven doomsday, keeping an updated list of topical questions and interviewing new community members for each edition.
• Score: 237.1458929375047
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The goal of this series is to chronicle opinions and issues in the field of machine learning as they stand today and as they change over time. The plan is to host this survey periodically until the AI singularity paperclip-frenzy-driven doomsday, keeping an updated list of topical questions and interviewing new community members for each edition. In this issue, we probed people's opinions on interpretable AI, the value of benchmarking in modern NLP, the state of progress towards understanding deep learning, and the future of academia.

Related papers

• Towards Bidirectional Human-AI Alignment: A Systematic Review for Clarifications, Framework, and Future Directions [101.67121669727354]
  Recent advancements in AI have highlighted the importance of guiding AI systems towards the intended goals, ethical principles, and values of individuals and groups, a concept broadly recognized as alignment. The lack of clarified definitions and scopes of human-AI alignment poses a significant obstacle, hampering collaborative efforts across research domains to achieve this alignment. We introduce a systematic review of over 400 papers published between 2019 and January 2024, spanning multiple domains such as Human-Computer Interaction (HCI), Natural Language Processing (NLP), Machine Learning (ML)
  arXiv  Detail & Related papers  (2024-06-13T16:03:25Z)
• Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews [51.453135368388686]
  We present an approach for estimating the fraction of text in a large corpus which is likely to be substantially modified or produced by a large language model (LLM) Our maximum likelihood model leverages expert-written and AI-generated reference texts to accurately and efficiently examine real-world LLM-use at the corpus level.
  arXiv  Detail & Related papers  (2024-03-11T21:51:39Z)
• On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models [77.86952307745763]
  Big models have achieved revolutionary breakthroughs in the field of AI, but they might also pose potential concerns. Addressing such concerns, alignment technologies were introduced to make these models conform to human preferences and values. Despite considerable advancements in the past year, various challenges lie in establishing the optimal alignment strategy.
  arXiv  Detail & Related papers  (2024-03-07T04:19:13Z)
• Unmasking the Shadows of AI: Investigating Deceptive Capabilities in Large Language Models [0.0]
  This research critically navigates the intricate landscape of AI deception, concentrating on deceptive behaviours of Large Language Models (LLMs) My objective is to elucidate this issue, examine the discourse surrounding it, and subsequently delve into its categorization and ramifications.
  arXiv  Detail & Related papers  (2024-02-07T00:21:46Z)
• Continual Learning: Applications and the Road Forward [119.03464063873407]
  Continual learning aims to allow machine learning models to continuously learn on new data, by accumulating knowledge without forgetting what was learned in the past. This work is the result of the many discussions the authors had at the Dagstuhl seminar on Deep Continual Learning, in March 2023.
  arXiv  Detail & Related papers  (2023-11-20T16:40:29Z)
• To Build Our Future, We Must Know Our Past: Contextualizing Paradigm Shifts in Natural Language Processing [14.15370310437262]
  We study factors that shape NLP as a field, including culture, incentives, and infrastructure. Our interviewees identify cyclical patterns in the field, as well as new shifts without historical parallel. We conclude by discussing shared visions, concerns, and hopes for the future of NLP.
  arXiv  Detail & Related papers  (2023-10-11T17:59:36Z)
• How to Design and Deliver Courses for Higher Education in the AI Era: Insights from Exam Data Analysis [0.41998444721319206]
  We advocate for the idea that courses and exams in the AI era have to be designed based on the strengths and limitations of AI. We show how we adopted a pedagogical approach that is inspired from the Socratic teaching method from January 2023 to May 2023. We present a new exam system that allows us to apply our pedagogical approach in the AI era.
  arXiv  Detail & Related papers  (2023-07-22T08:33:41Z)
• VQA and Visual Reasoning: An Overview of Recent Datasets, Methods and Challenges [1.565870461096057]
  The integration of vision and language has sparked a lot of attention as a result of this. The tasks have been created in such a way that they properly exemplify the concepts of deep learning.
  arXiv  Detail & Related papers  (2022-12-26T20:56:01Z)
• Threat of Adversarial Attacks on Deep Learning in Computer Vision: Survey II [86.51135909513047]
  Deep Learning is vulnerable to adversarial attacks that can manipulate its predictions. This article reviews the contributions made by the computer vision community in adversarial attacks on deep learning. It provides definitions of technical terminologies for non-experts in this domain.
  arXiv  Detail & Related papers  (2021-08-01T08:54:47Z)
• Not Quite 'Ask a Librarian': AI on the Nature, Value, and Future of LIS [7.1492901819376415]
  We ask the world's best language model, GPT-3, fifteen difficult questions about the nature, value, and future of library and information science. We present highlights from its 45 different responses, which range from platitudes and caricatures to interesting perspectives and worrisome visions of the future.
  arXiv  Detail & Related papers  (2021-07-07T15:20:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.