Dual use issues in the field of Natural Language Generation

• URL: http://arxiv.org/abs/2501.06636v1
• Date: Sat, 11 Jan 2025 20:55:35 GMT
• Title: Dual use issues in the field of Natural Language Generation
• Abstract summary: This report documents the results of a recent survey in the SIGGEN community, focusing on Dual Use issues in Natural Language Generation (NLG)<n>With 23 respondents, the survey is presumably not representative of all SIGGEN members, but at least this document offers a helpful resource for future discussions.
• Score: 2.1427900765416985
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This report documents the results of a recent survey in the SIGGEN community, focusing on Dual Use issues in Natural Language Generation (NLG). SIGGEN is the Special Interest Group (SIG) of the Association for Computational Linguistics (ACL) for researchers working on NLG. The survey was prompted by the ACL executive board, which asked all SIGs to provide an overview of dual use issues within their respective subfields. The survey was sent out in October 2024 and the results were processed in January 2025. With 23 respondents, the survey is presumably not representative of all SIGGEN members, but at least this document offers a helpful resource for future discussions. This report is open to feedback from the SIGGEN community. Let me know if you have any questions or comments!

Related papers

• What Limits Us? Analyzing Self-Reported Limitations in NLP Research [16.615805273207613]
  We conduct a large-scale analysis of the Limitations sections from ACL and EMNLP papers published between 2020 and 2025.<n>This framework enables us to investigate trends in self-reported limitations over time, their correlations with specific paper attributes, and the writing patterns that recur around these disclosures.<n>Our findings offer a critical reflection on the diverse reported challenges as well as the self-reporting practices of researchers in the NLP community.
  arXiv  Detail & Related papers  (2026-09-14T08:11:57Z)
• SurveyAgent-HKA: A multi-agent framework for scientific survey generation with LLMs and human knowledge augmentation [17.544221843099812]
  We introduce SurveyAgent-HKA, a multi-agent framework that improves end-to-end scientific survey generation.<n>The framework decomposes survey generation into well-defined sub-tasks handled by LLM-powered agent.<n>Our framework is efficient in both time and cost, making it a practical solution for broader AI-assisted scientific writing applications.
  arXiv  Detail & Related papers  (2026-09-05T07:03:47Z)
• Deep Academic Survey: Stateful Agentic Closed-Loop Paradigm for Academic Survey Automation [60.151050016855834]
  DAS is a stateful agentic framework for generating publication-oriented academic surveys.<n>Its key idea is to separate reusable paper analysis from topic-specific manuscript construction.<n>DAS achieves the highest average in all four dimensions, with an overall score of 4.34 compared with 4.03 for the strongest competitor.
  arXiv  Detail & Related papers  (2026-08-18T17:29:00Z)
• Overview of the TREC 2025 Retrieval Augmented Generation (RAG) Track [52.136178637532886]
  Second edition of the TREC Retrieval Augmented Generation (RAG) Track advances research on systems that integrate retrieval and generation.<n>Building on the foundation of the inaugural 2024 track, this year's challenge introduces long, multi-sentence narrative queries.<n>Participants are tasked with designing pipelines that combine retrieval and generation while ensuring transparency and factual grounding.
  arXiv  Detail & Related papers  (2026-03-10T16:49:18Z)
• The 3rd Place Solution of CCIR CUP 2025: A Framework for Retrieval-Augmented Generation in Multi-Turn Legal Conversation [7.363804447752668]
  We introduce our approach for "Legal Knowledge Retrieval and Generation" in CCIR CUP 2025.<n>By combining the advantages of information retrieval and large language models, RAG can generate relevant and contextually appropriate responses.
  arXiv  Detail & Related papers  (2025-10-17T15:12:15Z)
• SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation [37.921524136479825]
  SurGE (Survey Generation Evaluation) is a new benchmark for scientific survey generation in computer science.<n>SurGE consists of (1) a collection of test instances, each including a topic description, an expert-written survey, and its full set of cited references, and (2) a large-scale academic corpus of over one million papers.<n>In addition, we propose an automated evaluation framework that measures the quality of generated surveys across four dimensions.
  arXiv  Detail & Related papers  (2025-08-21T15:45:10Z)
• SpiritRAG: A Q&A System for Religion and Spirituality in the United Nations Archive [4.575515160275914]
  We present SpiritRAG, an interactive Question Answering (Q&A) system based on Retrieval-Augmented Generation (RAG)<n>Built using 7,500 United Nations (UN) resolution documents related to R/S in the domains of health and education, SpiritRAG allows researchers and policymakers to conduct complex, context-sensitive database searches.<n>A pilot test and evaluation with domain experts on 100 manually composed questions demonstrates the practical value and usefulness of SpiritRAG.
  arXiv  Detail & Related papers  (2025-07-06T13:54:54Z)
• Retrieval-Augmented Generation with Conflicting Evidence [57.66282463340297]
  Large language model (LLM) agents are increasingly employing retrieval-augmented generation (RAG) to improve the factuality of their responses. In practice, these systems often need to handle ambiguous user queries and potentially conflicting information from multiple sources. We propose RAMDocs (Retrieval with Ambiguity and Misinformation in Documents), a new dataset that simulates complex and realistic scenarios for conflicting evidence for a user query.
  arXiv  Detail & Related papers  (2025-04-17T16:46:11Z)
• LM Agents for Coordinating Multi-User Information Gathering [82.3543678605684]
  PeopleJoin is a benchmark for evaluating LM-mediated collaborative problem solving. PeopleJoin comprises two evaluation domains: PeopleJoin-QA and PeopleJoin-DocCreation.
  arXiv  Detail & Related papers  (2025-02-17T21:19:45Z)
• Uchaguzi-2022: A Dataset of Citizen Reports on the 2022 Kenyan Election [49.35115948941981]
  We present Uchaguzi-2022, a dataset of 14k categorized and geotagged citizen reports related to the 2022 Kenyan General Election.<n>We use this dataset to investigate whether language models can assist in scalably categorizing and geotagging reports, thus highlighting its potential application in the AI for Social Good space.
  arXiv  Detail & Related papers  (2024-12-17T17:08:35Z)
• Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experiment [59.09144776166979]
  Large language models (LLMs) represent a promising, but controversial, tool in aiding scientific peer review. This study evaluates the usefulness of LLMs in a conference setting as a tool for vetting paper submissions against submission standards.
  arXiv  Detail & Related papers  (2024-11-05T18:58:00Z)
• TREC iKAT 2023: The Interactive Knowledge Assistance Track Overview [11.276981461219515]
  iKAT emphasizes the creation and research of conversational search agents that adapt responses based on the user's prior interactions and present context. Most of the runs leveraged Large Language Models (LLMs) in their pipelines, with a few focusing on a generate-then-retrieve approach.
  arXiv  Detail & Related papers  (2024-01-02T18:40:03Z)
• SOUL: Towards Sentiment and Opinion Understanding of Language [96.74878032417054]
  We propose a new task called Sentiment and Opinion Understanding of Language (SOUL) SOUL aims to evaluate sentiment understanding through two subtasks: Review (RC) and Justification Generation (JG)
  arXiv  Detail & Related papers  (2023-10-27T06:48:48Z)
• The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions [114.67699010359637]
  We analyze a large-scale collection of real user queries to GPT. We find that tasks such as design'' and planning'' are prevalent in user interactions but are largely neglected or different from traditional NLP benchmarks.
  arXiv  Detail & Related papers  (2023-10-19T02:12:17Z)
• Beyond Good Intentions: Reporting the Research Landscape of NLP for Social Good [115.1507728564964]
  We introduce NLP4SG Papers, a scientific dataset with three associated tasks. These tasks help identify NLP4SG papers and characterize the NLP4SG landscape. We use state-of-the-art NLP models to address each of these tasks and use them on the entire ACL Anthology.
  arXiv  Detail & Related papers  (2023-05-09T14:16:25Z)
• The impact and applications of ChatGPT: a systematic review of literature reviews [0.0]
  ChatGPT has become one of the most widely used natural language processing tools. With thousands of published papers demonstrating its applications across various industries and fields, ChatGPT has sparked significant interest in the research community. An overview of the available evidence from multiple reviews and studies could provide further insights, minimize redundancy, and identify areas where further research is needed.
  arXiv  Detail & Related papers  (2023-05-08T17:57:34Z)
• What Do NLP Researchers Believe? Results of the NLP Community Metasurvey [43.763865378178245]
  We present the results of the NLP Community Metasurvey. The survey elicited opinions on controversial issues. We find false sociological beliefs where the community's predictions don't match reality.
  arXiv  Detail & Related papers  (2022-08-26T19:45:51Z)
• Overview of ADoBo 2021: Automatic Detection of Unassimilated Borrowings in the Spanish Press [8.950918531231158]
  This paper summarizes the main findings of the ADoBo 2021 shared task, proposed in the context of IberLef 2021. In this task, we invited participants to detect lexical borrowings (coming mostly from English) in Spanish newswire texts. We provided participants with an annotated corpus of lexical borrowings which we split into training, development and test splits.
  arXiv  Detail & Related papers  (2021-10-29T11:07:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.