Participation in the age of foundation models

• URL: http://arxiv.org/abs/2405.19479v1
• Date: Wed, 29 May 2024 19:53:23 GMT
• Title: Participation in the age of foundation models
• Authors: Harini Suresh, Emily Tseng, Meg Young, Mary L. Gray, Emma Pierson, Karen Levy,
• Abstract summary: Participatory approaches hold promise to lend agency and decision-making power to marginalized stakeholders. We examine existing attempts at incorporating participation into foundation models. We develop a blueprint for participatory foundation models that identifies more local, application-oriented opportunities for meaningful participation.
• Score: 5.0317146589850195
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Growing interest and investment in the capabilities of foundation models has positioned such systems to impact a wide array of public services. Alongside these opportunities is the risk that these systems reify existing power imbalances and cause disproportionate harm to marginalized communities. Participatory approaches hold promise to instead lend agency and decision-making power to marginalized stakeholders. But existing approaches in participatory AI/ML are typically deeply grounded in context - how do we apply these approaches to foundation models, which are, by design, disconnected from context? Our paper interrogates this question. First, we examine existing attempts at incorporating participation into foundation models. We highlight the tension between participation and scale, demonstrating that it is intractable for impacted communities to meaningfully shape a foundation model that is intended to be universally applicable. In response, we develop a blueprint for participatory foundation models that identifies more local, application-oriented opportunities for meaningful participation. In addition to the "foundation" layer, our framework proposes the "subfloor'' layer, in which stakeholders develop shared technical infrastructure, norms and governance for a grounded domain, and the "surface'' layer, in which affected communities shape the use of a foundation model for a specific downstream task. The intermediate "subfloor'' layer scopes the range of potential harms to consider, and affords communities more concrete avenues for deliberation and intervention. At the same time, it avoids duplicative effort by scaling input across relevant use cases. Through three case studies in clinical care, financial services, and journalism, we illustrate how this multi-layer model can create more meaningful opportunities for participation than solely intervening at the foundation layer.

Related papers

• Affective Computing Has Changed: The Foundation Model Disruption [47.88090382507161]
  We aim to raise awareness of the power of Foundation Models in the field of Affective Computing. We synthetically generate and analyse multimodal affective data, focusing on vision, linguistics, and speech (acoustics) We discuss some fundamental problems, such as ethical issues and regulatory aspects, related to the use of Foundation Models in this research area.
  arXiv  Detail & Related papers  (2024-09-13T15:20:18Z)
• Position: Cracking the Code of Cascading Disparity Towards Marginalized Communities [14.497314894554828]
  We discuss that disparities towards marginalized communities are not isolated concerns but rather interconnected elements of a cascading disparity phenomenon. We emphasize the unique threat of cascading impacts in foundation models, where interconnected disparities can trigger long-lasting negative consequences. We conclude with a set of calls to action to mitigate disparity at its source.
  arXiv  Detail & Related papers  (2024-06-03T19:52:41Z)
• Position: Foundation Agents as the Paradigm Shift for Decision Making [24.555816843983003]
  We advocate for the construction of foundation agents as a transformative shift in the learning paradigm of agents. We specify the roadmap of foundation agents from large interactive data collection or generation to self-supervised pretraining and adaptation.
  arXiv  Detail & Related papers  (2024-05-27T09:54:50Z)
• PLUG: Revisiting Amodal Segmentation with Foundation Model and Hierarchical Focus [19.25678147515461]
  We propose the first SAM-based amodal segmentation approach, PLUG. In the region level, due to the association and division in visible and occluded areas, inmodal and amodal regions are assigned as the focuses of distinct branches to avoid mutual disturbance. In the point level, we introduce the concept of uncertainty to explicitly assist the model in identifying and focusing on ambiguous points.
  arXiv  Detail & Related papers  (2024-05-25T06:58:20Z)
• On the Societal Impact of Open Foundation Models [93.67389739906561]
  We focus on open foundation models, defined here as those with broadly available model weights. We identify five distinctive properties of open foundation models that lead to both their benefits and risks.
  arXiv  Detail & Related papers  (2024-02-27T16:49:53Z)
• On Catastrophic Inheritance of Large Foundation Models [51.41727422011327]
  Large foundation models (LFMs) are claiming incredible performances. Yet great concerns have been raised about their mythic and uninterpreted potentials. We propose to identify a neglected issue deeply rooted in LFMs: Catastrophic Inheritance. We discuss the challenges behind this issue and propose UIM, a framework to understand the catastrophic inheritance of LFMs from both pre-training and downstream adaptation.
  arXiv  Detail & Related papers  (2024-02-02T21:21:55Z)
• A Survey of Reasoning with Foundation Models [235.7288855108172]
  Reasoning plays a pivotal role in various real-world settings such as negotiation, medical diagnosis, and criminal investigation. We introduce seminal foundation models proposed or adaptable for reasoning. We then delve into the potential future directions behind the emergence of reasoning abilities within foundation models.
  arXiv  Detail & Related papers  (2023-12-17T15:16:13Z)
• Foundation Models for Decision Making: Problems, Methods, and Opportunities [124.79381732197649]
  Foundation models pretrained on diverse data at scale have demonstrated extraordinary capabilities in a wide range of vision and language tasks. New paradigms are emerging for training foundation models to interact with other agents and perform long-term reasoning. Research at the intersection of foundation models and decision making holds tremendous promise for creating powerful new systems.
  arXiv  Detail & Related papers  (2023-03-07T18:44:07Z)
• The Equity Framework: Fairness Beyond Equalized Predictive Outcomes [0.0]
  We study fairness issues that arise when decision-makers use models that deviate from the models that depict the physical and social environment. We formulate an Equity Framework that considers equal access to the model, equal outcomes from the model, and equal utilization of the model.
  arXiv  Detail & Related papers  (2022-04-18T20:49:51Z)
• On the Opportunities and Risks of Foundation Models [256.61956234436553]
  We call these models foundation models to underscore their critically central yet incomplete character. This report provides a thorough account of the opportunities and risks of foundation models. To tackle these questions, we believe much of the critical research on foundation models will require deep interdisciplinary collaboration.
  arXiv  Detail & Related papers  (2021-08-16T17:50:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.