The Software Observatory: aggregating and analysing software metadata for trend computation and FAIR assessment

• URL: http://arxiv.org/abs/2510.05705v1
• Date: Tue, 07 Oct 2025 09:15:02 GMT
• Title: The Software Observatory: aggregating and analysing software metadata for trend computation and FAIR assessment
• Authors: Eva Martín del Pico, Josep Lluís Gelpí, Salvador Capella-Gutiérrez,
• Abstract summary: The Software Observatory at OpenEBench is a novel web portal that consolidates software metadata from various sources.<n>Our platform enables users to analyse trends, identify patterns and advancements within the Life Sciences research software ecosystem.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In the ever-changing realm of research software development, it is crucial for the scientific community to grasp current trends to identify gaps that can potentially hinder scientific progress. The adherence to the FAIR (Findable, Accessible, Interoperable, Reusable) principles can serve as a proxy to understand those trends and provide a mechanism to propose specific actions. The Software Observatory at OpenEBench (https://openebench.bsc.es/observatory) is a novel web portal that consolidates software metadata from various sources, offering comprehensive insights into critical research software aspects. Our platform enables users to analyse trends, identify patterns and advancements within the Life Sciences research software ecosystem, and understand its evolution over time. It also evaluates research software according to FAIR principles for research software, providing scores for different indicators. Users have the ability to visualise this metadata at different levels of granularity, ranging from the entire software landscape to specific communities to individual software entries through the FAIRsoft Evaluator. Indeed, the FAIRsoft Evaluator component streamlines the assessment process, helping developers efficiently evaluate and obtain guidance to improve their software's FAIRness. The Software Observatory represents a valuable resource for researchers and software developers, as well as stakeholders, promoting better software development practices and adherence to FAIR principles for research software.

Related papers

• Peer Code Review in Research Software Development: The Research Software Engineer Perspective [0.6385006149689549]
  While peer code review can improve software quality, its adoption by research software engineers (RSEs) remains unexplored.<n>This study explores RSE perspectives on peer code review, focusing on their practices, challenges, and potential improvements.
  arXiv  Detail & Related papers  (2025-11-13T20:07:10Z)
• Identity resolution of software metadata using Large Language Models [0.0]
  This article presents an evaluation of instruction-tuned large language models for the task of software metadata identity resolution.<n>We benchmarked multiple models against a human-annotated gold standard, examined their behavior on ambiguous cases, and introduced an agreement-based proxy for high-confidence automated decisions.
  arXiv  Detail & Related papers  (2025-05-29T14:47:31Z)
• Automated Testing of the GUI of a Real-Life Engineering Software using Large Language Models [45.498315114762484]
  Tests aim to determine unintuitive behavior of the software as it is presented to the end-user.<n>They provide valuable feedback for the development of the software, but are time-intensive to conduct.<n>We present GERALLT, a system that uses Large Language Models (LLMs) to perform exploratory tests of the Graphical User Interface (GUI) of a real-life engineering software.
  arXiv  Detail & Related papers  (2025-05-23T12:53:28Z)
• Estimating the Energy Footprint of Software Systems: a Primer [56.200335252600354]
  quantifying the energy footprint of a software system is one of the most basic activities. This document aims to be a starting point for researchers who want to begin conducting work in this area.
  arXiv  Detail & Related papers  (2024-07-16T11:21:30Z)
• Making Software Development More Diverse and Inclusive: Key Themes, Challenges, and Future Directions [50.545824691484796]
  We identify six themes around the theme challenges and opportunities to improve Software Developer Diversity and Inclusion (SDDI)<n>We identify benefits, harms, and future research directions for the four main themes.<n>We discuss the remaining two themes, Artificial Intelligence & SDDI and AI & Computer Science education, which have a cross-cutting effect on the other themes.
  arXiv  Detail & Related papers  (2024-04-10T16:18:11Z)
• Charting a Path to Efficient Onboarding: The Role of Software Visualization [49.1574468325115]
  The present study aims to explore the familiarity of managers, leaders, and developers with software visualization tools. This approach incorporated quantitative and qualitative analyses of data collected from practitioners using questionnaires and semi-structured interviews.
  arXiv  Detail & Related papers  (2024-01-17T21:30:45Z)
• SciCat: A Curated Dataset of Scientific Software Repositories [4.77982299447395]
  We introduce the SciCat dataset -- a comprehensive collection of Free-Libre Open Source Software (FLOSS) projects. Our approach involves selecting projects from a pool of 131 million deforked repositories from the World of Code data source. Our classification focuses on software designed for scientific purposes, research-related projects, and research support software.
  arXiv  Detail & Related papers  (2023-12-11T13:46:33Z)
• Embedded Software Development with Digital Twins: Specific Requirements for Small and Medium-Sized Enterprises [55.57032418885258]
  Digital twins have the potential for cost-effective software development and maintenance strategies. We interviewed SMEs about their current development processes. First results show that real-time requirements prevent, to date, a Software-in-the-Loop development approach.
  arXiv  Detail & Related papers  (2023-09-17T08:56:36Z)
• Using Machine Learning To Identify Software Weaknesses From Software Requirement Specifications [49.1574468325115]
  This research focuses on finding an efficient machine learning algorithm to identify software weaknesses from requirement specifications. Keywords extracted using latent semantic analysis help map the CWE categories to PROMISE_exp. Naive Bayes, support vector machine (SVM), decision trees, neural network, and convolutional neural network (CNN) algorithms were tested.
  arXiv  Detail & Related papers  (2023-08-10T13:19:10Z)
• A Metadata-Based Ecosystem to Improve the FAIRness of Research Software [0.3185506103768896]
  The reuse of research software is central to research efficiency and academic exchange. The DataDesc ecosystem is presented, an approach to describing data models of software interfaces with detailed and machine-actionable metadata.
  arXiv  Detail & Related papers  (2023-06-18T19:01:08Z)
• Evaluation of software impact designed for biomedical research: Are we measuring what's meaningful? [17.645303073710732]
  Analysis of usage and impact metrics can help developers determine user and community engagement. There are challenges associated with these analyses including distorted or misleading metrics. Some tools may be especially beneficial to a small audience, yet may not have compelling typical usage metrics.
  arXiv  Detail & Related papers  (2023-06-05T21:15:05Z)
• Empowered and Embedded: Ethics and Agile Processes [60.63670249088117]
  We argue that ethical considerations need to be embedded into the (agile) software development process. We put emphasis on the possibility to implement ethical deliberations in already existing and well established agile software development processes.
  arXiv  Detail & Related papers  (2021-07-15T11:14:03Z)
• Machine Learning for Software Engineering: A Systematic Mapping [73.30245214374027]
  The software development industry is rapidly adopting machine learning for transitioning modern day software systems towards highly intelligent and self-learning systems. No comprehensive study exists that explores the current state-of-the-art on the adoption of machine learning across software engineering life cycle stages. This study introduces a machine learning for software engineering (MLSE) taxonomy classifying the state-of-the-art machine learning techniques according to their applicability to various software engineering life cycle stages.
  arXiv  Detail & Related papers  (2020-05-27T11:56:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.