Both the validity of the cultural tightness index and the association with creativity and order are spurious -- a comment on Jackson et al

• URL: http://arxiv.org/abs/2201.10812v1
• Date: Wed, 26 Jan 2022 08:32:44 GMT
• Title: Both the validity of the cultural tightness index and the association with creativity and order are spurious -- a comment on Jackson et al
• Authors: Alexander Koplenig and Sascha Wolfer
• Abstract summary: Jackson et al. generate a linguistic index of cultural tightness based on the Google Books Ngram corpus. We show here that the methods used by Jackson et al. are neither suitable for testing the validity of the index nor for establishing possible relationships with creativity/order.
• Score: 77.34726150561087
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: It was recently suggested in a study published in Nature Human Behaviour that the historical loosening of American culture was associated with a trade-off between higher creativity and lower order. To this end, Jackson et al. generate a linguistic index of cultural tightness based on the Google Books Ngram corpus and use this index to show that American norms loosened between 1800 and 2000. While we remain agnostic toward a potential loosening of American culture and a statistical association with creativity/order, we show here that the methods used by Jackson et al. are neither suitable for testing the validity of the index nor for establishing possible relationships with creativity/order.

Related papers

• DaKultur: Evaluating the Cultural Awareness of Language Models for Danish with Native Speakers [17.355452637877402]
  We conduct the first cultural evaluation study for the mid-resource language of Danish, in which native speakers prompt different models to solve tasks requiring cultural awareness. Our analysis of the resulting 1,038 interactions from 63 demographically diverse participants highlights open challenges to cultural adaptation.
  arXiv  Detail & Related papers  (2025-04-03T08:52:42Z)
• Extrinsic Evaluation of Cultural Competence in Large Language Models [53.626808086522985]
  We focus on extrinsic evaluation of cultural competence in two text generation tasks. We evaluate model outputs when an explicit cue of culture, specifically nationality, is perturbed in the prompts. We find weak correlations between text similarity of outputs for different countries and the cultural values of these countries.
  arXiv  Detail & Related papers  (2024-06-17T14:03:27Z)
• CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models [59.22460740026037]
  "CIVICS: Culturally-Informed & Values-Inclusive Corpus for Societal impacts" dataset is designed to evaluate the social and cultural variation of Large Language Models (LLMs) We create a hand-crafted, multilingual dataset of value-laden prompts which address specific socially sensitive topics, including LGBTQI rights, social welfare, immigration, disability rights, and surrogacy.
  arXiv  Detail & Related papers  (2024-05-22T20:19:10Z)
• CultureBank: An Online Community-Driven Knowledge Base Towards Culturally Aware Language Technologies [53.2331634010413]
  CultureBank is a knowledge base built upon users' self-narratives. It contains 12K cultural descriptors sourced from TikTok and 11K from Reddit. We offer recommendations for future culturally aware language technologies.
  arXiv  Detail & Related papers  (2024-04-23T17:16:08Z)
• Values That Are Explicitly Present in Fairy Tales: Comparing Samples from German, Italian and Portuguese Traditions [0.3840425533789961]
  We study how values are communicated in fairy tales from Portugal, Italy and Germany using a technique called word embedding with a compass. We specify a list of value-charged tokens, consider their word stems and analyse the distance between these in a bespoke pre-trained Word2Vec model. Preliminary findings hint at a shared cultural understanding and the expression of values such as Benevolence, Conformity, and Universalism across the studied cultures.
  arXiv  Detail & Related papers  (2024-02-13T09:26:19Z)
• A ripple in time: a discontinuity in American history [49.84018914962972]
  We suggest a novel approach to discover temporal (related and unrelated to language dilation) and personality (authorship attribution) aspects in historical datasets. We exemplify our approach on the State of the Union addresses given by the past 42 US presidents.
  arXiv  Detail & Related papers  (2023-12-02T17:24:17Z)
• A Novel Method for Analysing Racial Bias: Collection of Person Level References [6.345851712811529]
  We propose a novel method to analyze the differences in representation between two groups. We examine the representation of African Americans and White Americans in books between 1850 to 2000 with the Google Books dataset.
  arXiv  Detail & Related papers  (2023-10-24T14:00:01Z)
• Query Expansion Using Contextual Clue Sampling with Language Models [69.51976926838232]
  We propose a combination of an effective filtering strategy and fusion of the retrieved documents based on the generation probability of each context. Our lexical matching based approach achieves a similar top-5/top-20 retrieval accuracy and higher top-100 accuracy compared with the well-established dense retrieval model DPR. For end-to-end QA, the reader model also benefits from our method and achieves the highest Exact-Match score against several competitive baselines.
  arXiv  Detail & Related papers  (2022-10-13T15:18:04Z)
• Mitigating Racial Biases in Toxic Language Detection with an Equity-Based Ensemble Framework [9.84413545378636]
  Recent research has demonstrated how racial biases against users who write African American English exist in popular toxic language datasets. We propose additional descriptive fairness metrics to better understand the source of these biases. We show that our proposed framework substantially reduces the racial biases that the model learns from these datasets.
  arXiv  Detail & Related papers  (2021-09-27T15:54:05Z)
• Semantics of European poetry is shaped by conservative forces: The relationship between poetic meter and meaning in accentual-syllabic verse [0.0]
  We provide the first large-scale formal evidence of the persistent association between poetic meter and semantics in 18-19th European literatures. Our study traces this association through a series of clustering experiments using the abstracted semantic features of 150,000 poems.
  arXiv  Detail & Related papers  (2021-09-15T08:20:01Z)
• Machine learning as a model for cultural learning: Teaching an algorithm what it means to be fat [2.0305676256390934]
  We show that neural word embeddings provide a parsimonious and cognitively plausible model of the representations learned from natural language. We identify several cultural schemata that link obesity to gender, immorality, poor health, and low socioeconomic class. Our findings reinforce ongoing concerns that machine learning can also encode, and reproduce, harmful human biases.
  arXiv  Detail & Related papers  (2020-03-24T00:47:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.