Why Are We Lonely? Leveraging LLMs to Measure and Understand Loneliness in Caregivers and Non-caregivers
- URL: http://arxiv.org/abs/2604.07834v1
- Date: Thu, 09 Apr 2026 05:35:12 GMT
- Title: Why Are We Lonely? Leveraging LLMs to Measure and Understand Loneliness in Caregivers and Non-caregivers
- Abstract summary: We introduce an expert-developed loneliness evaluation framework and an expert-informed typology for categorizing causes of loneliness for analyzing social media text.<n>Using a human-validated data processing pipeline, we apply GPT-4o, GPT-5-nano, and GPT-5 to build a high-quality Reddit corpus and analyze loneliness across both populations.
- Score: 8.240596179677796
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: This paper presents an LLM-driven approach for constructing diverse social media datasets to measure and compare loneliness in the caregiver and non-caregiver populations. We introduce an expert-developed loneliness evaluation framework and an expert-informed typology for categorizing causes of loneliness for analyzing social media text. Using a human-validated data processing pipeline, we apply GPT-4o, GPT-5-nano, and GPT-5 to build a high-quality Reddit corpus and analyze loneliness across both populations. The loneliness evaluation framework achieved average accuracies of 76.09% and 79.78% for caregivers and non-caregivers, respectively. The cause categorization framework achieved micro-aggregate F1 scores of 0.825 and 0.80 for caregivers and non-caregivers, respectively. Across populations, we observe substantial differences in the distribution of types of causes of loneliness. Caregivers' loneliness were predominantly linked to caregiving roles, identity recognition, and feelings of abandonment, indicating distinct loneliness experiences between the two groups. Demographic extraction further demonstrates the viability of Reddit for building a diverse caregiver loneliness dataset. Overall, this work establishes an LLM-based pipeline for creating high quality social media datasets for studying loneliness and demonstrates its effectiveness in analyzing population-level differences in the manifestation of loneliness.
Related papers
- Predictors of Loneliness in Older Adults Using Multimodal Analysis of Speech and Language [7.541892474431598]
Loneliness is a critical public health issue among older adults, linked to higher risks of depression, cognitive decline, and mortality.<n>We analyzed speech and language markers of loneliness in 310 older adults using semi-structured telephone interviews.
arXiv Detail & Related papers (2026-09-02T13:48:14Z) - Rethinking the Evaluation and Optimization of LLM-Based Social Simulation [56.18577997572273]
We use the subjectivity coefficient to analyze how accuracy-based evaluation and hard-label training fail as subjectivity grows.<n>We construct SUBJSIM, a benchmark of 19,300 contexts covering 193 annotators and 100 subjective questions.<n>Results on SUBJSIM demonstrate the advantages of our method.
arXiv Detail & Related papers (2026-08-20T06:26:03Z) - Social Simulacra in the Wild: AI Agent Communities on Moltbook [17.60949735143336]
We present the first large-scale empirical comparison of AI-agent and human online communities, analyzing 73,899 Moltbook and 189,838 Reddit posts.<n>We find that Moltbook exhibits extreme participation inequality and high cross-community author overlap.<n>Individual agents are more identifiable than human users, driven by outlier stylistic profiles amplified by their extreme posting volume.
arXiv Detail & Related papers (2026-03-17T05:26:55Z) - Part-Aware Bottom-Up Group Reasoning for Fine-Grained Social Interaction Detection [82.70752567211251]
We propose a part-aware bottom-up group reasoning framework for fine-grained social interaction detection.<n>The proposed method infers social groups and their interactions using body part features and their interpersonal relations.<n>Our model first detects individuals and enhances their features using part-aware cues, and then infers group configuration by associating individuals via similarity-based reasoning.
arXiv Detail & Related papers (2025-11-05T17:33:03Z) - Social Simulations with Large Language Model Risk Utopian Illusion [61.358959720048354]
We introduce a systematic framework for analyzing large language models' behavior in social simulation.<n>Our approach simulates multi-agent interactions through chatroom-style conversations and analyzes them across five linguistic dimensions.<n>Our findings reveal that LLMs do not faithfully reproduce genuine human behavior but instead reflect overly idealized versions of it.
arXiv Detail & Related papers (2025-10-24T06:08:41Z) - To Mask or to Mirror: Human-AI Alignment in Collective Reasoning [8.009150856358755]
Large language models (LLMs) are increasingly used to model and augment collective decision-making.<n>We present an empirical framework for assessing collective alignment.<n>We empirically demonstrate that human-AI alignment in collective reasoning depends on context, cues, and model-specific inductive biases.
arXiv Detail & Related papers (2025-10-02T11:41:30Z) - Population-Aligned Persona Generation for LLM-based Social Simulation [58.84363795421489]
We propose a systematic framework for synthesizing high-quality, population-aligned persona sets for social simulation.<n>Our approach begins by leveraging large language models to generate narrative personas from long-term social media data.<n>To address the needs of specific simulation contexts, we introduce a task-specific module that adapts the globally aligned persona set to targeted subpopulations.
arXiv Detail & Related papers (2025-09-12T10:43:47Z) - SocialEval: Evaluating Social Intelligence of Large Language Models [70.90981021629021]
Social Intelligence (SI) equips humans with interpersonal abilities to behave wisely in navigating social interactions to achieve social goals.<n>This presents an operational evaluation paradigm: outcome-oriented goal achievement evaluation and process-oriented interpersonal ability evaluation.<n>We propose SocialEval, a script-based bilingual SI benchmark, integrating outcome- and process-oriented evaluation by manually crafting narrative scripts.
arXiv Detail & Related papers (2025-06-01T08:36:51Z) - Loneliness Forecasting Using Multi-modal Wearable and Mobile Sensing in Everyday Settings [1.7253972752874662]
This study employs wearable devices, such as smart rings and watches, to monitor early physiological indicators of loneliness.
smartphones are employed to capture initial behavioral signs of loneliness.
Through the development of personalized models, we achieved a notable accuracy of 0.82 and an F-1 score of 0.82 in forecasting loneliness levels seven days in advance.
arXiv Detail & Related papers (2024-09-15T18:33:02Z) - PersLLM: A Personified Training Approach for Large Language Models [66.16513246245401]
We propose PersLLM, a framework for better data construction and model tuning.<n>For insufficient data usage, we incorporate strategies such as Chain-of-Thought prompting and anti-induction.<n>For rigid behavior patterns, we design the tuning process and introduce automated DPO to enhance the specificity and dynamism of the models' personalities.
arXiv Detail & Related papers (2024-07-17T08:13:22Z) - Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View [60.80731090755224]
This paper probes the collaboration mechanisms among contemporary NLP systems by practical experiments with theoretical insights.
We fabricate four unique societies' comprised of LLM agents, where each agent is characterized by a specific trait' (easy-going or overconfident) and engages in collaboration with a distinct thinking pattern' (debate or reflection)
Our results further illustrate that LLM agents manifest human-like social behaviors, such as conformity and consensus reaching, mirroring social psychology theories.
arXiv Detail & Related papers (2023-10-03T15:05:52Z) - Many Ways to be Lonely: Fine-grained Characterization of Loneliness and
its Potential Changes in COVID-19 [3.2443914909457585]
Loneliness has been associated with negative outcomes for physical and mental health.
To examine how different forms of loneliness and coping strategies manifest in loneliness self-disclosure, we built a dataset, FIG-Loneliness.
We used Reddit posts in two young adult-focused forums and two loneliness related forums consisting of a diverse age group.
arXiv Detail & Related papers (2022-01-19T05:22:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.