A Tool for Automatically Cataloguing and Selecting Pre-Trained Models and Datasets for Software Engineering
- URL: http://arxiv.org/abs/2601.13460v1
- Date: Mon, 19 Jan 2026 23:34:43 GMT
- Title: A Tool for Automatically Cataloguing and Selecting Pre-Trained Models and Datasets for Software Engineering
- Abstract summary: We present MLAssetSelection, a web application that automatically extracts Software Engineering (SE) assets.<n>Real-time automated updates through scheduled jobs keep asset information current.<n>User-centric features include login, personalized asset lists, and alert notifications.
- Score: 43.48024589076806
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The rapid growth of machine learning assets has made it increasingly difficult for software engineers to identify models and datasets that match their specific needs. Browsing large registries, such as Hugging Face, is time-consuming, error-prone, and rarely tailored to Software Engineering (SE) tasks. We present MLAssetSelection, a web application that automatically extracts SE assets and supports four key functionalities: (i) a configurable leaderboard for ranking models across multiple benchmarks and metrics; (ii) requirements-based selection of models and datasets; (iii) real-time automated updates through scheduled jobs that keep asset information current; and (iv) user-centric features including login, personalized asset lists, and configurable alert notifications. A demonstration video is available at https://youtu.be/t6CJ6P9asV4.
Related papers
- VESTA: Visual Exploration with Statistical Tool Agents [56.76643750765825]
We introduce VESTA: Visual Exploration with Statistical Tool Agents.<n>We show that VESTA's dynamic tool creation outperforms prior agentic pipelines.<n>We also introduce DAWN, a benchmark targeting distribution fitting and time series.
arXiv Detail & Related papers (2026-05-29T21:57:37Z) - SEMODS: A Validated Dataset of Open-Source Software Engineering Models [46.647605887771284]
We present SEMODS: an SE-focused dataset of 3,427 models extracted from Hugging Face (HF)<n>Our dataset links models to SE tasks and activities from the software development lifecycle, offering a standardized representation of their evaluation results.
arXiv Detail & Related papers (2026-01-02T10:38:24Z) - ELATE: Evolutionary Language model for Automated Time-series Engineering [2.121963121603413]
We introduce ELATE (Evolutionary Language model for Automated Time-series Engineering) to automate feature engineering for time-series data.<n>ELATE employs time-series statistical measures and feature importance metrics to guide and prune features, while the language model proposes new, contextually relevant feature transformations.<n>Our experiments demonstrate that ELATE improves forecasting accuracy by an average of 8.4% across various domains.
arXiv Detail & Related papers (2025-08-20T12:36:29Z) - How do Pre-Trained Models Support Software Engineering? An Empirical Study in Hugging Face [52.257764273141184]
Open-Source Pre-Trained Models (PTMs) provide extensive resources for various Machine Learning (ML) tasks.<n>These resources lack a classification tailored to Software Engineering (SE) needs.<n>We derive a taxonomy encompassing 147 SE tasks and apply an SE-oriented classification to PTMs in a popular open-source ML repository, Hugging Face (HF)<n>We find that code generation is the most common SE task among PTMs, while requirements engineering and software design activities receive limited attention.
arXiv Detail & Related papers (2025-06-03T15:51:17Z) - CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and Augmentation [51.2289822267563]
We propose a method for generating synthetic datasets, given a small number of user-written few-shots that demonstrate the task to be performed.<n>We demonstrate that CRAFT can efficiently generate large-scale task-specific training datasets for four diverse tasks: biology, medicine, and commonsense question-answering (QA)<n>Our experiments show that CRAFT-based models outperform or match general LLMs on QA tasks, while exceeding models trained on human-curated summarization data by 46 preference points.
arXiv Detail & Related papers (2024-09-03T17:54:40Z) - Automated User Story Generation with Test Case Specification Using Large Language Model [0.0]
We developed a tool "GeneUS" to automatically create user stories from requirements documents.
The output is provided in format leaving the possibilities open for downstream integration to the popular project management tools.
arXiv Detail & Related papers (2024-04-02T01:45:57Z) - AutoAct: Automatic Agent Learning from Scratch for QA via Self-Planning [54.47116888545878]
AutoAct is an automatic agent learning framework for QA.
It does not rely on large-scale annotated data and synthetic planning trajectories from closed-source models.
arXiv Detail & Related papers (2024-01-10T16:57:24Z) - Mining Robust Default Configurations for Resource-constrained AutoML [18.326426020906215]
We present a novel method of selecting performant configurations for a given task by performing offline autoML and mining over a diverse set of tasks.
We show that our approach is effective for warm-starting existing autoML platforms.
arXiv Detail & Related papers (2022-02-20T23:08:04Z) - Merlion: A Machine Learning Library for Time Series [73.46386700728577]
Merlion is an open-source machine learning library for time series.
It features a unified interface for models and datasets for anomaly detection and forecasting.
Merlion also provides a unique evaluation framework that simulates the live deployment and re-training of a model in production.
arXiv Detail & Related papers (2021-09-20T02:03:43Z) - Automated Machine Learning Techniques for Data Streams [91.3755431537592]
This paper surveys the state-of-the-art open-source AutoML tools, applies them to data collected from streams, and measures how their performance changes over time.
The results show that off-the-shelf AutoML tools can provide satisfactory results but in the presence of concept drift, detection or adaptation techniques have to be applied to maintain the predictive accuracy over time.
arXiv Detail & Related papers (2021-06-14T11:42:46Z) - AutoAI-TS: AutoAI for Time Series Forecasting [14.078195334596494]
We present AutoAI for Time Series Forecasting (AutoAI-TS) that provides users with a zero configuration (zero-conf) system.
AutoAI-TS automatically performs all the data preparation, model creation, parameter optimization, training and model selection for users.
It then evaluates and ranks pipelines using the proposed T-Daub mechanism to choose the best pipeline.
arXiv Detail & Related papers (2021-02-24T15:30:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.