Theory In, Theory Out: The uses of social theory in machine learning for social science

• URL: http://arxiv.org/abs/2001.03203v3
• Date: Wed, 15 Jan 2020 16:11:10 GMT
• Title: Theory In, Theory Out: The uses of social theory in machine learning for social science
• Authors: Jason Radford and Kenneth Joseph
• Abstract summary: We show how social theory can be used to answer the basic methodological and interpretive questions that arise at each stage of the machine learning pipeline. We believe this paper can act as a guide for computer and social scientists alike to navigate the substantive questions involved in applying the tools of machine learning to social data.
• Score: 3.180013942295509
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Research at the intersection of machine learning and the social sciences has provided critical new insights into social behavior. At the same time, a variety of critiques have been raised ranging from technical issues with the data used and features constructed, problematic assumptions built into models, their limited interpretability, and their contribution to bias and inequality. We argue such issues arise primarily because of the lack of social theory at various stages of the model building and analysis. In the first half of this paper, we walk through how social theory can be used to answer the basic methodological and interpretive questions that arise at each stage of the machine learning pipeline. In the second half, we show how theory can be used to assess and compare the quality of different social learning models, including interpreting, generalizing, and assessing the fairness of models. We believe this paper can act as a guide for computer and social scientists alike to navigate the substantive questions involved in applying the tools of machine learning to social data.

Related papers

• AI and Social Theory [0.0]
  We sketch a programme for AI driven social theory, starting by defining what we mean by artificial intelligence (AI) We then lay out our model for how AI based models can draw on the growing availability of digital data to help test the validity of different social theories based on their predictive power.
  arXiv  Detail & Related papers  (2024-07-07T12:26:16Z)
• Towards Asimov's Psychohistory: Harnessing Topological Data Analysis, Artificial Intelligence and Social Media data to Forecast Societal Trends [0.0]
  In the age of big data and advanced computational methods, the prediction of large-scale social behaviors is becoming increasingly feasible. This paper consists of a theoretical exploration of the integration of computational power and mathematical frameworks. I argue that these tools provide unprecedented clarity into the dynamics of large communities.
  arXiv  Detail & Related papers  (2024-07-03T18:44:36Z)
• Advancing Social Intelligence in AI Agents: Technical Challenges and Open Questions [67.60397632819202]
  Building socially-intelligent AI agents (Social-AI) is a multidisciplinary, multimodal research goal. We identify a set of underlying technical challenges and open questions for researchers across computing communities to advance Social-AI.
  arXiv  Detail & Related papers  (2024-04-17T02:57:42Z)
• DeSIQ: Towards an Unbiased, Challenging Benchmark for Social Intelligence Understanding [60.84356161106069]
  We study the soundness of Social-IQ, a dataset of multiple-choice questions on videos of complex social interactions. Our analysis reveals that Social-IQ contains substantial biases, which can be exploited by a moderately strong language model. We introduce DeSIQ, a new challenging dataset, constructed by applying simple perturbations to Social-IQ.
  arXiv  Detail & Related papers  (2023-10-24T06:21:34Z)
• Neural Theory-of-Mind? On the Limits of Social Intelligence in Large LMs [77.88043871260466]
  We show that one of today's largest language models lacks this kind of social intelligence out-of-the box. We conclude that person-centric NLP approaches might be more effective towards neural Theory of Mind.
  arXiv  Detail & Related papers  (2022-10-24T14:58:58Z)
• Predicting Opinion Dynamics via Sociologically-Informed Neural Networks [31.77040611129394]
  We present Sociologically-Informed Neural Network (SINN), which integrates theoretical models and social media data. In particular, we recast theoretical models as ordinary differential equations (ODEs) We train a neural network that simultaneously approximates the data and conforms to the ODEs that represent the social scientific knowledge.
  arXiv  Detail & Related papers  (2022-07-07T05:55:47Z)
• Individual Explanations in Machine Learning Models: A Case Study on Poverty Estimation [63.18666008322476]
  Machine learning methods are being increasingly applied in sensitive societal contexts. The present case study has two main objectives. First, to expose these challenges and how they affect the use of relevant and novel explanations methods. And second, to present a set of strategies that mitigate such challenges, as faced when implementing explanation methods in a relevant application domain.
  arXiv  Detail & Related papers  (2021-04-09T01:54:58Z)
• Individual Explanations in Machine Learning Models: A Survey for Practitioners [69.02688684221265]
  The use of sophisticated statistical models that influence decisions in domains of high societal relevance is on the rise. Many governments, institutions, and companies are reluctant to their adoption as their output is often difficult to explain in human-interpretable ways. Recently, the academic literature has proposed a substantial amount of methods for providing interpretable explanations to machine learning models.
  arXiv  Detail & Related papers  (2021-04-09T01:46:34Z)
• The Use and Misuse of Counterfactuals in Ethical Machine Learning [2.28438857884398]
  We argue for more caution with the use of counterfactuals when the facts to be considered are social categories such as race or gender. We conclude that the counterfactual approach in machine learning fairness and social explainability can require an incoherent theory of what social categories are.
  arXiv  Detail & Related papers  (2021-02-09T19:28:41Z)
• How social feedback processing in the brain shapes collective opinion processes in the era of social media [0.0]
  Drawing on recent neuro-scientific insights into the processing of social feedback, we develop a theoretical model that allows to address these questions. Even strong majorities can be forced into silence if a minority acts as a cohesive whole. The proposed framework of social feedback theory highlights the need for sociological theorising to understand the societal-level implications of findings in social and cognitive neuroscience.
  arXiv  Detail & Related papers  (2020-03-18T11:06:34Z)
• A general framework for scientifically inspired explanations in AI [76.48625630211943]
  We instantiate the concept of structure of scientific explanation as the theoretical underpinning for a general framework in which explanations for AI systems can be implemented. This framework aims to provide the tools to build a "mental-model" of any AI system so that the interaction with the user can provide information on demand and be closer to the nature of human-made explanations.
  arXiv  Detail & Related papers  (2020-03-02T10:32:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.