HSS-Synth: Humanities and Social Sciences Data Synthesis for LLMs

• URL: http://arxiv.org/abs/2607.27379v1
• Date: Wed, 29 Jul 2026 18:37:14 GMT
• Title: HSS-Synth: Humanities and Social Sciences Data Synthesis for LLMs
• Abstract summary: We introduce HSS- Synth, the first data synthesis pipeline for the humanities and social sciences.<n>HSS- Synth comprises: (1) constructing seed documents from web corpora via multi-step filtering and text refinement evaluated by a judge; (2) specifying "requirements + persona" to back seed documents into diverse yet faithful instructions with a strict Q&A alignment check; and (3) breaking LLM response limits via teacher-forced Answering.
• Score: 49.984192011187275
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: High-quality, diverse data are vital for large language models (LLMs) but remain scarce and costly. Data synthesis is a viable alternative and succeeds on closed tasks, yet the humanities and social sciences (HSS) are overlooked, and their open-ended nature makes synthesis challenging. Moving beyond prior capability-centric, fragmented attempts, we adopt a subject-centric paradigm, define the first HSS domain system covering 14 mainstream fields, and introduce HSS-Synth, the first data synthesis pipeline for HSS. HSS-Synth comprises: (1) constructing seed documents from web corpora via multi-step filtering and text refinement evaluated by a judge; (2) specifying "requirements + persona" to backtranslate seed documents into diverse yet faithful instructions with a strict Q&A alignment check; and (3) breaking LLM response limits via teacher-forced Answering that feeds seed documents during response generation to anchor semantics, reduce hallucinations, and preserve tone and integrity. HSS-Synth yields 237k high-quality, diverse instruction-tuning samples that outperform 14 leading baselines on 16 benchmarks. The fine-tuned Qwen3-8B-Base sets a new SOTA and approaches the official Qwen3-8B, improving both human preference and knowledge capabilities without performance seesaws. Extensive experiments demonstrate HSS-Synth's robustness and transferability. Our code is publicly available at https://github.com/pengr/HSS-Synth.

Related papers

• SciLENS: RL-Driven Autonomous Agents for Scientific Localized Evidence Navigation and Synthesis [25.589775096416176]
  SciLENS is a fully local autonomous agent framework operating on a dual-tier infrastructure.<n>We pioneer the integration of structural visualization as an actionable tool within the reasoning loop.<n>We develop an automated data synthesis pipeline that extracts subgraphs from a citation knowledge graph.<n>The agent is subsequently aligned through a reverse-decomposition strategy.
  arXiv  Detail & Related papers  (2026-09-03T03:54:43Z)
• BridgeAlign: Bridging Preference Alignment for Humanities and Social Sciences [52.67755020436915]
  We propose BridgeAlign, among the first preference-alignment pipelines for broad social sciences disciplines.<n>We show that BridgeAlign can achieve the best average across 17 benchmarks against 11 strong baselines.
  arXiv  Detail & Related papers  (2026-07-29T18:22:50Z)
• InfoSynth: Information-Guided Benchmark Synthesis for LLMs [69.80981631587501]
  Large language models (LLMs) have demonstrated significant advancements in reasoning and code generation.<n>Traditional benchmark creation relies on manual human effort, a process that is both expensive and time-consuming.<n>This work introduces Info Synth, a novel framework for automatically generating and evaluating reasoning benchmarks.
  arXiv  Detail & Related papers  (2026-01-02T05:26:27Z)
• Label Semantics for Robust Hyperspectral Image Classification [6.578456055730258]
  Hyperspectral imaging (HSI) classification is a critical tool in diverse fields such as agriculture, environmental monitoring, medicine, and materials science.<n>Due to the limited availability of high-quality training samples and the high dimensionality of spectral data, HSI classification models are prone to overfitting and often face challenges in balancing accuracy and computational complexity.<n>We propose a general-purpose Semantic Spectral-Spatial Fusion Network (S3FN) that uses contextual, class specific textual descriptions to complement the training of an HSI classification model.
  arXiv  Detail & Related papers  (2025-10-08T21:13:11Z)
• DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesis [52.636738269442766]
  We introduce DeepScholar-bench, a live benchmark and holistic, automated evaluation framework designed to evaluate generative research synthesis systems.<n>DeepScholar-bench draws queries from recent, high-quality ArXiv papers and focuses on a real research synthesis task.<n>We also develop DeepScholar-base, a reference pipeline implemented efficiently using the LOTUS API.
  arXiv  Detail & Related papers  (2025-08-27T16:36:34Z)
• Scaling Laws of Synthetic Data for Language Models [125.41600201811417]
  We introduce SynthLLM, a scalable framework that transforms pre-training corpora into diverse, high-quality synthetic datasets.<n>Our approach achieves this by automatically extracting and recombining high-level concepts across multiple documents using a graph algorithm.
  arXiv  Detail & Related papers  (2025-03-25T11:07:12Z)
• SynthesizRR: Generating Diverse Datasets with Retrieval Augmentation [55.2480439325792]
  We study the synthesis of six datasets, covering topic classification, sentiment analysis, tone detection, and humor. We find that SynthesizRR greatly improves lexical and semantic diversity, similarity to human-written text, and distillation performance.
  arXiv  Detail & Related papers  (2024-05-16T12:22:41Z)
• Skip the Benchmark: Generating System-Level High-Level Synthesis Data using Generative Machine Learning [8.416553728391309]
  High-Level Synthesis (HLS) Design Space Exploration (DSE) is a widely accepted approach for exploring optimal hardware solutions during the HLS process. Several HLS benchmarks and datasets are available for the research community to evaluate their methodologies. This paper proposes a novel approach, called Vaegan, that employs generative machine learning to generate synthetic data that is robust enough to support complex system-level HLS DSE experiments.
  arXiv  Detail & Related papers  (2024-04-23T05:32:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.