Advancing Computing's Foundation of US Industry & Society
- URL: http://arxiv.org/abs/2101.01284v1
- Date: Mon, 4 Jan 2021 23:40:45 GMT
- Title: Advancing Computing's Foundation of US Industry & Society
- Authors: Thomas M. Conte, Ian T. Foster, William Gropp, and Mark D. Hill
- Abstract summary: Underlying IT's impact are the dramatic improvements in computer hardware, which deliver performance that unlock new capabilities.
Will we make the next AI leap without 100x better hardware?
This whitepaper argues for a multipronged effort to develop new computing approaches beyond Moore's Law.
- Score: 1.443696537295348
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: While past information technology (IT) advances have transformed society,
future advances hold even greater promise. For example, we have only just begun
to reap the changes from artificial intelligence (AI), especially machine
learning (ML). Underlying IT's impact are the dramatic improvements in computer
hardware, which deliver performance that unlock new capabilities. For example,
recent successes in AI/ML required the synergy of improved algorithms and
hardware architectures (e.g., general-purpose graphics processing units).
However, unlike in the 20th Century and early 2000s, tomorrow's performance
aspirations must be achieved without continued semiconductor scaling formerly
provided by Moore's Law and Dennard Scaling. How will one deliver the next 100x
improvement in capability at similar or less cost to enable great value? Can we
make the next AI leap without 100x better hardware?
This whitepaper argues for a multipronged effort to develop new computing
approaches beyond Moore's Law to advance the foundation that computing provides
to US industry, education, medicine, science, and government. This impact
extends far beyond the IT industry itself, as IT is now central for providing
value across society, for example in semi-autonomous vehicles, tele-education,
health wearables, viral analysis, and efficient administration. Herein we draw
upon considerable visioning work by CRA's Computing Community Consortium (CCC)
and the IEEE Rebooting Computing Initiative (IEEE RCI), enabled by thought
leader input from industry, academia, and the US government.
Related papers
- Challenges and Paths Towards AI for Software Engineering [55.95365538122656]
We discuss progress in AI for software engineering in threefold manner.
First, we provide a structured taxonomy of concrete tasks in AI for software engineering.
Second, we outline several key bottlenecks that limit current approaches.
arXiv Detail & Related papers (2025-03-28T17:17:57Z) - Computing Power and the Governance of Artificial Intelligence [51.967584623262674]
Governments and companies have started to leverage compute as a means to govern AI.
compute-based policies and technologies have the potential to assist in these areas, but there is significant variation in their readiness for implementation.
naive or poorly scoped approaches to compute governance carry significant risks in areas like privacy, economic impacts, and centralization of power.
arXiv Detail & Related papers (2024-02-13T21:10:21Z) - Brain-Inspired Computational Intelligence via Predictive Coding [89.6335791546526]
Predictive coding (PC) has shown promising performance in machine intelligence tasks.
PC can model information processing in different brain areas, can be used in cognitive control and robotics.
arXiv Detail & Related papers (2023-08-15T16:37:16Z) - Physical Computing for Materials Acceleration Platforms [81.09376948478891]
We argue that the same simulation and AI tools that will accelerate the search for new materials, as part of the MAPs research program, also make possible the design of fundamentally new computing mediums.
We outline a simulation-based MAP program to design computers that use physics itself to solve optimization problems.
We expect to introduce a new era of innovative collaboration between materials researchers and computer scientists.
arXiv Detail & Related papers (2022-08-17T23:03:54Z) - Future Computer Systems and Networking Research in the Netherlands: A
Manifesto [137.47124933818066]
We draw attention to CompSys as a vital part of ICT.
Each of the Top Sectors of the Dutch Economy, each route in the National Research Agenda, and each of the UN Sustainable Development Goals pose challenges that cannot be addressed without CompSys advances.
arXiv Detail & Related papers (2022-05-26T11:02:29Z) - Edge-Cloud Polarization and Collaboration: A Comprehensive Survey [61.05059817550049]
We conduct a systematic review for both cloud and edge AI.
We are the first to set up the collaborative learning mechanism for cloud and edge modeling.
We discuss potentials and practical experiences of some on-going advanced edge AI topics.
arXiv Detail & Related papers (2021-11-11T05:58:23Z) - Compute and Energy Consumption Trends in Deep Learning Inference [67.32875669386488]
We study relevant models in the areas of computer vision and natural language processing.
For a sustained increase in performance we see a much softer growth in energy consumption than previously anticipated.
arXiv Detail & Related papers (2021-09-12T09:40:18Z) - Nanotechnology-inspired Information Processing Systems of the Future [6.965518964839632]
Nanoscale semiconductor technology has been a key enabler of the computing revolution.
There needs to be a sustained and heavy investment in a nation-wide Vertically Integrated Semiconductor Ecosystem.
A nation-wide VISE provides clear strategic advantages in ensuring the US's global superiority in semiconductors.
arXiv Detail & Related papers (2020-05-05T18:52:25Z) - How deep the machine learning can be [0.0]
Machine learning is mostly based on the conventional computing (processors)
This paper attempts to review some of the caveats, especially concerning scaling the computing performance of the AI solutions.
arXiv Detail & Related papers (2020-05-02T16:06:31Z) - Memristors -- from In-memory computing, Deep Learning Acceleration,
Spiking Neural Networks, to the Future of Neuromorphic and Bio-inspired
Computing [25.16076541420544]
Machine learning, particularly in the form of deep learning, has driven most of the recent fundamental developments in artificial intelligence.
Deep learning has been successfully applied in areas such as object/pattern recognition, speech and natural language processing, self-driving vehicles, intelligent self-diagnostics tools, autonomous robots, knowledgeable personal assistants, and monitoring.
This paper reviews the case for a novel beyond CMOS hardware technology, memristors, as a potential solution for the implementation of power-efficient in-memory computing, deep learning accelerators, and spiking neural networks.
arXiv Detail & Related papers (2020-04-30T16:49:03Z) - Convergence of Artificial Intelligence and High Performance Computing on
NSF-supported Cyberinfrastructure [3.4291439418246177]
Artificial Intelligence (AI) applications have powered transformational solutions for big data challenges in industry and technology.
As AI continues to evolve into a computing paradigm endowed with statistical and mathematical rigor, it has become apparent that single- GPU solutions for training, validation, and testing are no longer sufficient.
This realization has been driving the confluence of AI and high performance computing to reduce time-to-insight.
arXiv Detail & Related papers (2020-03-18T18:00:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.