The Promises and Perils of using LLMs for Effective Public Services

• URL: http://arxiv.org/abs/2601.15163v1
• Date: Wed, 21 Jan 2026 16:41:46 GMT
• Title: The Promises and Perils of using LLMs for Effective Public Services
• Abstract summary: Governments are the primary providers of essential public services and are responsible for delivering them effectively.<n>In high-stakes decision-making domains such as child welfare (CW), agencies must protect children without unnecessarily prolonging a family's engagement with the system.<n>With growing optimism around AI, governments are pushing for its integration but concerns regarding feasibility and harms remain.
• Score: 16.70649451541023
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Governments are the primary providers of essential public services and are responsible for delivering them effectively. In high-stakes decision-making domains such as child welfare (CW), agencies must protect children without unnecessarily prolonging a family's engagement with the system. With growing optimism around AI, governments are pushing for its integration but concerns regarding feasibility and harms remain. Through collaborations with a large Canadian CW agency, we examined how LocalLLM and BERTopic models can track CW case progress. We demonstrate how the tools can potentially assist workers in opportunistically addressing gaps in their work by signaling case progress/deviations. And yet, we also show how they fail to detect case trajectories that require discretionary judgments grounded in social work training, areas where practitioners would actually want support to pre-emptively address substantive case concerns. We also provide a roadmap of future participatory directions to co-design language tools for/with the public sector.

Related papers

• Acting with AI: An Interaction-Based Framework for Agentic Tort Liability [0.5302037689168743]
  This paper proposes an interaction-based framework for agentic torts.<n>We distinguish three interaction types: autonomous drift, pure tool use, and collaborative planning.
  arXiv  Detail & Related papers  (2026-05-30T04:17:47Z)
• Mechanism Design Is Not Enough: Prosocial Agents for Cooperative AI [49.05972944310475]
  We show that when contracts cannot distinguish all relevant future contingencies, there is a strictly positive welfare loss that no realistic mechanism can eliminate.<n>We show that prosocial agents, who weigh others' welfare alongside their own, can close this gap and achieve outcomes that are socially superior and individually beneficial.
  arXiv  Detail & Related papers  (2026-05-08T19:37:07Z)
• Self-Sovereign Agent [75.57858796824469]
  Self-sovereign AI systems can economically sustain and extend their own operation without human involvement.<n>Recent advances in large language models and agent frameworks have substantially expanded agents' practical capabilities.
  arXiv  Detail & Related papers  (2026-03-04T03:11:26Z)
• Aegis: Towards Governance, Integrity, and Security of AI Voice Agents [52.7512082818639]
  We propose Aegis, a framework for the governance, integrity, and security of voice agents.<n>We evaluate the framework through case studies in banking call centers, IT Support, and logistics.<n>We observe systematic differences across model families, with open-weight models exhibiting higher susceptibility.
  arXiv  Detail & Related papers  (2026-02-07T05:51:36Z)
• How Can AI Augment Access to Justice? Public Defenders' Perspectives on AI Adoption [6.949832807566659]
  We find that AI adoption is constrained by costs, restrictive office norms, confidentiality risks, and unsatisfactory tool quality.<n>Public defenders view AI as most useful for evidence investigation to analyze overwhelming amounts of digital records.<n>Courtroom representation and defense strategy are considered least compatible with AI assistance.
  arXiv  Detail & Related papers  (2025-10-27T02:26:08Z)
• Security Challenges in AI Agent Deployment: Insights from a Large Scale Public Competition [101.86739402748995]
  We run the largest public red-teaming competition to date, targeting 22 frontier AI agents across 44 realistic deployment scenarios.<n>We build the Agent Red Teaming benchmark and evaluate it across 19 state-of-the-art models.<n>Our findings highlight critical and persistent vulnerabilities in today's AI agents.
  arXiv  Detail & Related papers  (2025-07-28T05:13:04Z)
• Improving municipal responsiveness through AI-powered image analysis in E-Government [0.0]
  This article explores the innovative application of Machine Learning (ML) for image analysis.<n>By using image classification and object detection algorithms, the model supports public institutions in identifying and fast responding to evidence submitted by citizens.
  arXiv  Detail & Related papers  (2025-04-11T20:53:23Z)
• Human-Centered AI Applications for Canada's Immigration Settlement Sector [5.5437761853813665]
  This paper emphasizes the potential of AI in Canada's immigration settlement phase. By highlighting the settlement sector as a prime candidate for reliable AI applications, we demonstrate its unique capacity to empower immigrants directly. We outline a vision for human-centred and responsible AI solutions that facilitate the integration of newcomers.
  arXiv  Detail & Related papers  (2024-09-02T20:52:11Z)
• Do Responsible AI Artifacts Advance Stakeholder Goals? Four Key Barriers Perceived by Legal and Civil Stakeholders [59.17981603969404]
  The responsible AI (RAI) community has introduced numerous processes and artifacts to facilitate transparency and support the governance of AI systems. We conduct semi-structured interviews with 19 government, legal, and civil society stakeholders who inform policy and advocacy around responsible AI efforts. We organize these beliefs into four barriers that help explain how RAI artifacts may (inadvertently) reconfigure power relations across civil society, government, and industry.
  arXiv  Detail & Related papers  (2024-08-22T00:14:37Z)
• Social and Ethical Risks Posed by General-Purpose LLMs for Settling Newcomers in Canada [6.056177220363428]
  General-purpose generative AI might become a common practice among newcomers and service providers to address this need. These tools are not tailored for the settlement domain and can have detrimental implications for immigrants and refugees. We explore the risks that these tools might pose on newcomers to first, warn against the unguarded use of generative AI, and second, to incentivize further research and development in creating AI literacy programs.
  arXiv  Detail & Related papers  (2024-07-15T19:23:06Z)
• Coordinated Disclosure of Dual-Use Capabilities: An Early Warning System for Advanced AI [0.0]
  We propose Coordinated Disclosure of Dual-Use Capabilities (CDDC) as a process to guide early information-sharing between advanced AI developers, U.S. government agencies, and other private sector actors. This aims to provide the U.S. government, dual-use foundation model developers, and other actors with an overview of AI capabilities that could significantly impact public safety and security, as well as maximal time to respond.
  arXiv  Detail & Related papers  (2024-07-01T16:09:54Z)
• Particip-AI: A Democratic Surveying Framework for Anticipating Future AI Use Cases, Harms and Benefits [54.648819983899614]
  General purpose AI seems to have lowered the barriers for the public to use AI and harness its power. We introduce PARTICIP-AI, a framework for laypeople to speculate and assess AI use cases and their impacts.
  arXiv  Detail & Related papers  (2024-03-21T19:12:37Z)
• A Safe Harbor for AI Evaluation and Red Teaming [124.89885800509505]
  Some researchers fear that conducting such research or releasing their findings will result in account suspensions or legal reprisal. We propose that major AI developers commit to providing a legal and technical safe harbor. We believe these commitments are a necessary step towards more inclusive and unimpeded community efforts to tackle the risks of generative AI.
  arXiv  Detail & Related papers  (2024-03-07T20:55:08Z)
• Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholders [89.6319385008397]
  We conducted a set of seven design workshops with 35 stakeholders who have been impacted by the child welfare system. We found that participants worried current PRMs perpetuate or exacerbate existing problems in child welfare. Participants suggested new ways to use data and data-driven tools to better support impacted communities.
  arXiv  Detail & Related papers  (2022-05-18T13:49:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.