Sociocultural Norm Similarities and Differences via Situational Alignment and Explainable Textual Entailment

• URL: http://arxiv.org/abs/2305.14492v2
• Date: Mon, 23 Oct 2023 00:53:01 GMT
• Title: Sociocultural Norm Similarities and Differences via Situational Alignment and Explainable Textual Entailment
• Authors: Sky CH-Wang, Arkadiy Saakyan, Oliver Li, Zhou Yu, Smaranda Muresan
• Abstract summary: We propose a novel approach to discover and compare social norms across Chinese and American cultures. We build a high-quality dataset of 3,069 social norms aligned with social situations across Chinese and American cultures. To test the ability of models to reason about social norms across cultures, we introduce the task of explainable social norm entailment.
• Score: 31.929550141633218
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Designing systems that can reason across cultures requires that they are grounded in the norms of the contexts in which they operate. However, current research on developing computational models of social norms has primarily focused on American society. Here, we propose a novel approach to discover and compare descriptive social norms across Chinese and American cultures. We demonstrate our approach by leveraging discussions on a Chinese Q&A platform (Zhihu) and the existing SocialChemistry dataset as proxies for contrasting cultural axes, align social situations cross-culturally, and extract social norms from texts using in-context learning. Embedding Chain-of-Thought prompting in a human-AI collaborative framework, we build a high-quality dataset of 3,069 social norms aligned with social situations across Chinese and American cultures alongside corresponding free-text explanations. To test the ability of models to reason about social norms across cultures, we introduce the task of explainable social norm entailment, showing that existing models under 3B parameters have significant room for improvement in both automatic and human evaluation. Further analysis of cross-cultural norm differences based on our dataset shows empirical alignment with the social orientations framework, revealing several situational and descriptive nuances in norms across these cultures.

Related papers

• Scalable Frame-based Construction of Sociocultural NormBases for Socially-Aware Dialogues [66.69453609603875]
  Sociocultural norms serve as guiding principles for personal conduct in social interactions. We propose a scalable approach for constructing a Sociocultural Norm (SCN) Base using Large Language Models (LLMs) We construct a comprehensive and publicly accessible Chinese Sociocultural NormBase.
  arXiv  Detail & Related papers  (2024-10-04T00:08:46Z)
• Towards "Differential AI Psychology" and in-context Value-driven Statement Alignment with Moral Foundations Theory [0.0]
  This work investigates the alignment between personalized language models and survey participants on a Moral Foundation questionnaire. We adapt text-to-text models to different political personas and survey the questionnaire repetitively to generate a synthetic population of persona and model combinations. Our findings indicate that adapted models struggle to represent the survey-leading assessment of political ideologies.
  arXiv  Detail & Related papers  (2024-08-21T08:20:41Z)
• ValueScope: Unveiling Implicit Norms and Values via Return Potential Model of Social Interactions [47.85181608392683]
  We employ ValueScope to dissect and analyze linguistic and stylistic expressions across 13 Reddit communities. Our analysis provides a quantitative foundation showing that even closely related communities exhibit remarkably diverse norms.
  arXiv  Detail & Related papers  (2024-07-02T17:51:27Z)
• Extrinsic Evaluation of Cultural Competence in Large Language Models [53.626808086522985]
  We focus on extrinsic evaluation of cultural competence in two text generation tasks. We evaluate model outputs when an explicit cue of culture, specifically nationality, is perturbed in the prompts. We find weak correlations between text similarity of outputs for different countries and the cultural values of these countries.
  arXiv  Detail & Related papers  (2024-06-17T14:03:27Z)
• From a Social Cognitive Perspective: Context-aware Visual Social Relationship Recognition [59.57095498284501]
  We propose a novel approach that recognizes textbfContextual textbfSocial textbfRelationships (textbfConSoR) from a social cognitive perspective. We construct social-aware descriptive language prompts with social relationships for each image. Impressively, ConSoR outperforms previous methods with a 12.2% gain on the People-in-Social-Context (PISC) dataset and a 9.8% increase on the People-in-Photo-Album (PIPA) benchmark.
  arXiv  Detail & Related papers  (2024-06-12T16:02:28Z)
• NormAd: A Framework for Measuring the Cultural Adaptability of Large Language Models [26.64843536942309]
  We introduce NormAd, an evaluation framework to assess large language models' cultural adaptability. We show that NormAd-Eti measures models' ability to judge social acceptability across different levels of cultural norm specificity. We find that models are better at recognizing socially acceptable versus unacceptable situations.
  arXiv  Detail & Related papers  (2024-04-18T18:48:50Z)
• "We Demand Justice!": Towards Social Context Grounding of Political Texts [19.58924256275583]
  Social media discourse frequently consists of'seemingly similar language used by opposing sides of the political spectrum' This paper defines the context required to fully understand such ambiguous statements in a computational setting. We propose two challenging datasets that require an understanding of the real-world context of the text.
  arXiv  Detail & Related papers  (2023-11-15T16:53:35Z)
• NormDial: A Comparable Bilingual Synthetic Dialog Dataset for Modeling Social Norm Adherence and Violation [18.605252945314724]
  We present a high-quality dyadic dialogue dataset with turn-by-turn annotations of social norm adherences and violations for Chinese and American cultures. Our dataset is synthetically generated in both Chinese and English using a human-in-the-loop pipeline.
  arXiv  Detail & Related papers  (2023-10-23T04:38:34Z)
• Social Chemistry 101: Learning to Reason about Social and Moral Norms [73.23298385380636]
  We present Social Chemistry, a new conceptual formalism to study people's everyday social norms and moral judgments. Social-Chem-101 is a large-scale corpus that catalogs 292k rules-of-thumb. Our model framework, Neural Norm Transformer, learns and generalizes Social-Chem-101 to successfully reason about previously unseen situations.
  arXiv  Detail & Related papers  (2020-11-01T20:16:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.