Infrastructure Engineering: A Still Missing, Undervalued Role in the Research Ecosystem

• URL: http://arxiv.org/abs/2405.10473v2
• Date: Tue, 28 May 2024 21:34:38 GMT
• Title: Infrastructure Engineering: A Still Missing, Undervalued Role in the Research Ecosystem
• Authors: Vanessa Sochat,
• Abstract summary: Research has become increasingly reliant on software. The need for such a role is not just ideal, but essential for the continued success of science. In this article we will highlight the importance of this missing layer, providing examples of how a missing role of infrastructure engineer has led to inefficiencies.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Research has become increasingly reliant on software, serving as the driving force behind bioinformatics, high performance computing, physics, machine learning and artificial intelligence, to name a few. While substantial progress has been made in advocating for the research software engineer, a kind of software engineer that typically works directly on software and associated assets that go into research, little attention has been placed on the workforce behind research infrastructure and innovation, namely compilers and compatibility tool development, orchestration and scheduling infrastructure, developer environments, container technologies, and workflow managers. As economic incentives are moving toward different models of cloud computing and innovating is required to develop new paradigms that represent the best of both worlds, an effort called "converged computing," the need for such a role is not just ideal, but essential for the continued success of science. While scattered staff in non-traditional roles have found time to work on some facets of this space, the lack of a larger workforce and incentive to support it has led to the scientific community falling behind. In this article we will highlight the importance of this missing layer, providing examples of how a missing role of infrastructure engineer has led to inefficiencies in the interoperability, portability, and reproducibility of science. We suggest that an inability to allocate, provide resources for, and sustain individuals to work explicitly on these technologies could lead to possible futures that are sub-optimal for the continued success of our scientific communities.

Related papers

• Transforming the Hybrid Cloud for Emerging AI Workloads [81.15269563290326]
  This white paper envisions transforming hybrid cloud systems to meet the growing complexity of AI workloads. The proposed framework addresses critical challenges in energy efficiency, performance, and cost-effectiveness. This joint initiative aims to establish hybrid clouds as secure, efficient, and sustainable platforms.
  arXiv  Detail & Related papers  (2024-11-20T11:57:43Z)
• SciOps: Achieving Productivity and Reliability in Data-Intensive Research [0.8414742293641504]
  Scientists are increasingly leveraging advances in instruments, automation, and collaborative tools to scale up their experiments and research goals. Various scientific disciplines, including neuroscience, have adopted key technologies to enhance collaboration, inspiration and automation. We introduce a five-level Capability Maturity Model describing the principles of rigorous scientific operations.
  arXiv  Detail & Related papers  (2023-12-29T21:37:22Z)
• A cast of thousands: How the IDEAS Productivity project has advanced software productivity and sustainability [1.3083336716269756]
  Concerns are growing about the productivity of the developers of scientific software. Members of the IDEAS project serve as catalysts to address these challenges. This paper discusses how these synergistic activities are advancing scientific discovery-mitigating technical risks.
  arXiv  Detail & Related papers  (2023-11-03T16:14:17Z)
• On the Opportunities of Green Computing: A Survey [80.21955522431168]
  Artificial Intelligence (AI) has achieved significant advancements in technology and research with the development over several decades. The needs for high computing power brings higher carbon emission and undermines research fairness. To tackle the challenges of computing resources and environmental impact of AI, Green Computing has become a hot research topic.
  arXiv  Detail & Related papers  (2023-11-01T11:16:41Z)
• Computation-efficient Deep Learning for Computer Vision: A Survey [121.84121397440337]
  Deep learning models have reached or even exceeded human-level performance in a range of visual perception tasks. Deep learning models usually demand significant computational resources, leading to impractical power consumption, latency, or carbon emissions in real-world scenarios. New research focus is computationally efficient deep learning, which strives to achieve satisfactory performance while minimizing the computational cost during inference.
  arXiv  Detail & Related papers  (2023-08-27T03:55:28Z)
• The Future of Fundamental Science Led by Generative Closed-Loop Artificial Intelligence [67.70415658080121]
  Recent advances in machine learning and AI are disrupting technological innovation, product development, and society as a whole. AI has contributed less to fundamental science in part because large data sets of high-quality data for scientific practice and model discovery are more difficult to access. Here we explore and investigate aspects of an AI-driven, automated, closed-loop approach to scientific discovery.
  arXiv  Detail & Related papers  (2023-07-09T21:16:56Z)
• Coordinated Science Laboratory 70th Anniversary Symposium: The Future of Computing [80.72844751804166]
  In 2021, the Coordinated Science Laboratory CSL hosted the Future of Computing Symposium to celebrate its 70th anniversary. We summarize the major technological points, insights, and directions that speakers brought forward during the symposium. Participants discussed topics related to new computing paradigms, technologies, algorithms, behaviors, and research challenges to be expected in the future.
  arXiv  Detail & Related papers  (2022-10-04T17:32:27Z)
• Future Computer Systems and Networking Research in the Netherlands: A Manifesto [137.47124933818066]
  We draw attention to CompSys as a vital part of ICT. Each of the Top Sectors of the Dutch Economy, each route in the National Research Agenda, and each of the UN Sustainable Development Goals pose challenges that cannot be addressed without CompSys advances.
  arXiv  Detail & Related papers  (2022-05-26T11:02:29Z)
• Infrastructure for Artificial Intelligence, Quantum and High Performance Computing [0.5760524510298753]
  Researchers in these areas depend on access to computing infrastructure, but these resources are in short supply and are typically siloed in support of their research. This paper argues that a more-holistic approach to computing infrastructure, one that recognizes the convergence of some capabilities, is needed to support computer science research.
  arXiv  Detail & Related papers  (2020-12-16T22:41:24Z)
• Convergence of Artificial Intelligence and High Performance Computing on NSF-supported Cyberinfrastructure [3.4291439418246177]
  Artificial Intelligence (AI) applications have powered transformational solutions for big data challenges in industry and technology. As AI continues to evolve into a computing paradigm endowed with statistical and mathematical rigor, it has become apparent that single- GPU solutions for training, validation, and testing are no longer sufficient. This realization has been driving the confluence of AI and high performance computing to reduce time-to-insight.
  arXiv  Detail & Related papers  (2020-03-18T18:00:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.