Will Dynamic Arrays finally change the way Models are built?

• URL: http://arxiv.org/abs/2006.14706v2
• Date: Mon, 5 Feb 2024 14:26:32 GMT
• Title: Will Dynamic Arrays finally change the way Models are built?
• Authors: Peter Bartholomew
• Abstract summary: Spreadsheets offer a supremely successful and intuitive means of processing and exchanging numerical content. Their ad-hoc nature makes it hugely popular for use in diverse areas including business and engineering. Many would question whether it is suitable for serious analysis or modelling tasks.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Spreadsheets offer a supremely successful and intuitive means of processing and exchanging numerical content. Its intuitive ad-hoc nature makes it hugely popular for use in diverse areas including business and engineering, yet these very same characteristics make it extraordinarily error-prone; many would question whether it is suitable for serious analysis or modelling tasks. A previous EuSpRIG paper examined the role of Names in increasing solution transparency and providing a readable notation to forge links with the problem domain. Extensive use was made of CSE array formulas, but it is acknowledged that their use makes spreadsheet development a distinctly cumbersome task. Since that time, the new dynamic arrays have been introduced and array calculation is now the default mode of operation for Excel. This paper examines the thesis that their adoption within a more professional development environment could replace traditional techniques where solution integrity is important. A major advantage of fully dynamic models is that they require less manual intervention to keep them updated and so have the potential to reduce the attendant errors and risk.

Related papers

• Tabular Embedding Model (TEM): Finetuning Embedding Models For Tabular RAG Applications [0.0]
  Tabular Embedding Model (TEM) is a novel approach to fine-tune embedding models for tabular Retrieval-Augmentation Generation (RAG) applications. TEM not only outperforms current SOTA embedding models in this domain but also does so with a notably smaller and more efficient model structure.
  arXiv  Detail & Related papers  (2024-04-28T14:58:55Z)
• Making Pre-trained Language Models Great on Tabular Prediction [50.70574370855663]
  The transferability of deep neural networks (DNNs) has made significant progress in image and language processing. We present TP-BERTa, a specifically pre-trained LM for tabular data prediction. A novel relative magnitude tokenization converts scalar numerical feature values to finely discrete, high-dimensional tokens, and an intra-feature attention approach integrates feature values with the corresponding feature names.
  arXiv  Detail & Related papers  (2024-03-04T08:38:56Z)
• TACTiS-2: Better, Faster, Simpler Attentional Copulas for Multivariate Time Series [57.4208255711412]
  Building on copula theory, we propose a simplified objective for the recently-introduced transformer-based attentional copulas (TACTiS) We show that the resulting model has significantly better training dynamics and achieves state-of-the-art performance across diverse real-world forecasting tasks.
  arXiv  Detail & Related papers  (2023-10-02T16:45:19Z)
• Excel as a Turing-complete Functional Programming Environment [0.0]
  The Excel calculation engine was the subject of a major upgrade to accommodate Dynamic Arrays in 2018. This paper will show the ad-hoc end user practices of traditional spreadsheets can be replaced by radically different approaches. It is too early to guess the extent to which the new functionality will be adopted by the business and engineering communities.
  arXiv  Detail & Related papers  (2023-08-31T20:11:36Z)
• ExcelFormer: A neural network surpassing GBDTs on tabular data [30.113818454081056]
  We propose ExcelFormer, a framework for a robust, effective, dataset-versatile, user-friendly tabular prediction approach. ExcelFormer addresses three key drawbacks of deep tabular models, including (P1) lack of rotational variance property, (P2) large data demand, and (P3) over-smooth solution. Extensive and stratified experiments conducted on real-world datasets demonstrate that our model outperforms previous approaches.
  arXiv  Detail & Related papers  (2023-01-07T09:42:03Z)
• Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization [99.6826401545377]
  Foundation models are redefining how AI systems are built. Practitioners now follow a standard procedure to build their machine learning solutions. We propose model ratatouille, a new strategy to recycle the multiple fine-tunings of the same foundation model on diverse auxiliary tasks.
  arXiv  Detail & Related papers  (2022-12-20T17:21:46Z)
• Revision Transformers: Instructing Language Models to Change their Values [21.645935518842744]
  Current transformer language models (LM) are large-scale models with billions of parameters. We propose the Revision Transformer (RiT) to facilitate easy model updating. The specific combination of a large-scale pre-trained LM that inherently but also diffusely encodes world knowledge with a clear-structured revision engine makes it possible to update the model's knowledge with little effort and the help of user interaction.
  arXiv  Detail & Related papers  (2022-10-19T07:05:06Z)
• HyperImpute: Generalized Iterative Imputation with Automatic Model Selection [77.86861638371926]
  We propose a generalized iterative imputation framework for adaptively and automatically configuring column-wise models. We provide a concrete implementation with out-of-the-box learners, simulators, and interfaces.
  arXiv  Detail & Related papers  (2022-06-15T19:10:35Z)
• Making Table Understanding Work in Practice [9.352813774921655]
  We discuss three challenges of deploying table understanding models and propose a framework to address them. We present SigmaTyper which encapsulates a hybrid model trained on GitTables and integrates a lightweight human-in-the-loop approach to customize the model.
  arXiv  Detail & Related papers  (2021-09-11T03:38:24Z)
• Discrete Auto-regressive Variational Attention Models for Text Modeling [53.38382932162732]
  Variational autoencoders (VAEs) have been widely applied for text modeling. They are troubled by two challenges: information underrepresentation and posterior collapse. We propose Discrete Auto-regressive Variational Attention Model (DAVAM) to address the challenges.
  arXiv  Detail & Related papers  (2021-06-16T06:36:26Z)
• Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensembles [78.6363825307044]
  We propose Explainable Matrix (ExMatrix), a novel visualization method for Random Forest (RF) interpretability. It employs a simple yet powerful matrix-like visual metaphor, where rows are rules, columns are features, and cells are rules predicates. ExMatrix applicability is confirmed via different examples, showing how it can be used in practice to promote RF models interpretability.
  arXiv  Detail & Related papers  (2020-05-08T21:03:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.