Tinkering Against Scaling

• URL: http://arxiv.org/abs/2504.16546v1
• Date: Wed, 23 Apr 2025 09:21:39 GMT
• Title: Tinkering Against Scaling
• Authors: Bolun Zhang, Yang Shen, Linzhuo Li, Yu Ji, Di Wu, Tongyu Wu, Lianghao Dai,
• Abstract summary: We propose a "tinkering" approach that is inspired by existing works.<n>This method involves engaging with smaller models or components that are manageable for ordinary researchers.<n>We argue that tinkering is both a way of making and knowing for computational social science and a way of knowing for critical studies.
• Score: 15.060264126253212
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: The ascent of scaling in artificial intelligence research has revolutionized the field over the past decade, yet it presents significant challenges for academic researchers, particularly in computational social science and critical algorithm studies. The dominance of large language models, characterized by their extensive parameters and costly training processes, creates a disparity where only industry-affiliated researchers can access these resources. This imbalance restricts academic researchers from fully understanding their tools, leading to issues like reproducibility in computational social science and a reliance on black-box metaphors in critical studies. To address these challenges, we propose a "tinkering" approach that is inspired by existing works. This method involves engaging with smaller models or components that are manageable for ordinary researchers, fostering hands-on interaction with algorithms. We argue that tinkering is both a way of making and knowing for computational social science and a way of knowing for critical studies, and fundamentally, it is a way of caring that has broader implications for both fields.

Related papers

• A Review of Neuroscience-Inspired Machine Learning [58.72729525961739]
  Bio-plausible credit assignment is compatible with practically any learning condition and is energy-efficient. In this paper, we survey several vital algorithms that model bio-plausible rules of credit assignment in artificial neural networks. We conclude by discussing the future challenges that will need to be addressed in order to make such algorithms more useful in practical applications.
  arXiv  Detail & Related papers  (2024-02-16T18:05:09Z)
• The Compute Divide in Machine Learning: A Threat to Academic Contribution and Scrutiny? [1.0985060632689174]
  We show that a compute divide has coincided with a reduced representation of academic-only research teams in compute intensive research topics. To address the challenges arising from this trend, we recommend approaches aimed at thoughtfully expanding academic insights.
  arXiv  Detail & Related papers  (2024-01-04T01:26:11Z)
• On the Opportunities of Green Computing: A Survey [80.21955522431168]
  Artificial Intelligence (AI) has achieved significant advancements in technology and research with the development over several decades. The needs for high computing power brings higher carbon emission and undermines research fairness. To tackle the challenges of computing resources and environmental impact of AI, Green Computing has become a hot research topic.
  arXiv  Detail & Related papers  (2023-11-01T11:16:41Z)
• Deep Learning in Deterministic Computational Mechanics [0.0]
  This review focuses on deep learning methods rather than applications for computational mechanics. The primary audience is researchers at the verge of entering this field or those who attempt to gain an overview of deep learning in computational mechanics.
  arXiv  Detail & Related papers  (2023-09-27T05:57:19Z)
• Machine Psychology [54.287802134327485]
  We argue that a fruitful direction for research is engaging large language models in behavioral experiments inspired by psychology. We highlight theoretical perspectives, experimental paradigms, and computational analysis techniques that this approach brings to the table. It paves the way for a "machine psychology" for generative artificial intelligence (AI) that goes beyond performance benchmarks.
  arXiv  Detail & Related papers  (2023-03-24T13:24:41Z)
• Research Trends and Applications of Data Augmentation Algorithms [77.34726150561087]
  We identify the main areas of application of data augmentation algorithms, the types of algorithms used, significant research trends, their progression over time and research gaps in data augmentation literature. We expect readers to understand the potential of data augmentation, as well as identify future research directions and open questions within data augmentation research.
  arXiv  Detail & Related papers  (2022-07-18T11:38:32Z)
• Word Embedding for Social Sciences: An Interdisciplinary Survey [9.657531563610767]
  We build a taxonomy to illustrate the methods and procedures used in the surveyed papers. This survey also conducts a simple experiment to warn that common similarity measurements used in the literature could yield different results.
  arXiv  Detail & Related papers  (2022-07-07T04:49:21Z)
• On Heuristic Models, Assumptions, and Parameters [0.76146285961466]
  We argue that the social effects of computing can depend just as much on obscure technical caveats, choices, and qualifiers. We describe three classes of objects used to encode these choices and qualifiers: models, assumptions, and parameters. We raise six reasons these objects may be hazardous to comprehensive analysis of computing and argue they deserve deliberate consideration as researchers explain scientific work.
  arXiv  Detail & Related papers  (2022-01-19T04:32:11Z)
• Scientia Potentia Est -- On the Role of Knowledge in Computational Argumentation [52.903665881174845]
  We propose a pyramid of types of knowledge required in computational argumentation. We briefly discuss the state of the art on the role and integration of these types in the field.
  arXiv  Detail & Related papers  (2021-07-01T08:12:41Z)
• Knowledge as Invariance -- History and Perspectives of Knowledge-augmented Machine Learning [69.99522650448213]
  Research in machine learning is at a turning point. Research interests are shifting away from increasing the performance of highly parameterized models to exceedingly specific tasks. This white paper provides an introduction and discussion of this emerging field in machine learning research.
  arXiv  Detail & Related papers  (2020-12-21T15:07:19Z)
• Qualities, challenges and future of genetic algorithms: a literature review [0.0]
  Genetic algorithms are computer programs that simulate natural evolution. They have been used to solve various optimisation problems from neural network architecture search to strategic games. Recent developments such as GPU, parallel and quantum computing, conception of powerful parameter control methods, and novel approaches in representation strategies may be keys to overcome their limitations.
  arXiv  Detail & Related papers  (2020-11-05T17:53:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.