OpenIIR: An Open Simulation Platform for Information Retrieval Research

• URL: http://arxiv.org/abs/2605.09321v2
• Date: Thu, 14 May 2026 08:54:52 GMT
• Title: OpenIIR: An Open Simulation Platform for Information Retrieval Research
• Abstract summary: OpenIIR runs hundreds of LLM-driven personas as parameterised, reproducible IR research experiments.<n>Researchers configure agents across four kinds of multi-agent study.<n>Same study can be re-run under different settings to compare outcomes side by side.
• Score: 1.1105673928718571
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: OpenIIR runs hundreds of LLM-driven personas as parameterised, reproducible IR research experiments. Researchers configure agents across four kinds of multi-agent study (deliberative panels, social platforms, curated recommender feeds, and evolutionary co-evolution between content producers and credibility detectors) under many priors, rounds, and constraints. Persona budgets, retrieval policies, ranker choices, intervention timings, and mutation rates are declared up front, and the same study can be re-run under different settings to compare outcomes side by side. Every run produces structured outputs (argument graphs, exposure logs, fitness traces, transcripts) that a downstream evaluator can consume directly, and a new study is a 200--400 line plug-in over a shared core (agent runtime, world-model store, retrieval primitives, claim extractor, persona ontology). The contributions are: (i) the shared core; (ii) a type interface for pluggable scenarios; (iii) four released types with reference runs (Panel, Social-Media, Curated-Feed, Multi-Generational); and (iv) six modular extensions sketched against open IR research questions.

Related papers

• SciForge: An AI-Native, Multimodal Workbench for Scientific Discovery [48.99744520105086]
  SciForge is a multimodal research-native AI workbench.<n>It reserves the graphical interface for human judgment while search, parsing, model routing, workflow execution, plotting, writing, and presentation generation run as modular agent-accessible services.
  arXiv  Detail & Related papers  (2026-07-17T15:13:03Z)
• Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generation [74.0621258662676]
  We propose Ptah, a multi-agent harness for interleaved report generation.<n>Ptah orchestrates the lifecycle from user query to rendered web report through planning, research, and writing stages.<n>A verifier agent serves as the harness's acceptance function, enforcing factual grounding, citation fidelity, and cross-modal consistency throughout the workflow.
  arXiv  Detail & Related papers  (2026-05-28T12:40:34Z)
• ARIS: Autonomous Research via Adversarial Multi-Agent Collaboration [10.076972559007116]
  ARIS (Auto-Research-in-sleep) is an open-source research harness for autonomous research.<n>ARIS coordinates machine-learning research through cross-model adversarial collaboration.
  arXiv  Detail & Related papers  (2026-05-04T18:10:15Z)
• The Last Human-Written Paper: Agent-Native Research Artifacts [106.47848184955576]
  We introduce the Agent-Native Research Artifact (ARA), a protocol that replaces the narrative paper with a machine-executable research package.<n>Three mechanisms support the ecosystem: a Live Research Manager that captures decisions and dead ends during ordinary development; an ARA Compiler that translates legacy PDFs and repos into ARAs; and an ARA-native review system that automates objective checks so human reviewers can focus on significance, novelty, and taste.
  arXiv  Detail & Related papers  (2026-04-27T16:23:09Z)
• Beyond One Output: Visualizing and Comparing Distributions of Language Model Generations [41.44731948887627]
  GROVE is an interactive visualization that represents multiple generations as overlapping paths through a text graph.<n>We evaluate three crowdsourced user studies targeting complementary distributional tasks.
  arXiv  Detail & Related papers  (2026-04-20T18:22:31Z)
• ORBIT: Scalable and Verifiable Data Generation for Search Agents on a Tight Budget [56.6320292944541]
  ORBIT is a training dataset with 20K reasoning-intensive queries with short verifiable answers.<n>Our framework, code and datasets are open-sourced and available publicly.
  arXiv  Detail & Related papers  (2026-04-01T17:42:41Z)
• AgentIR: Reasoning-Aware Retrieval for Deep Research Agents [76.29382561831105]
  Deep Research agents generate explicit natural language reasoning before each search call.<n> Reasoning-Aware Retrieval embeds the agent's reasoning trace alongside its query.<n>DR- Synth generates Deep Research retriever training data from standard QA datasets.<n>AgentIR-4B achieves 68% accuracy with the open-weight agent Tongyi-DeepResearch.
  arXiv  Detail & Related papers  (2026-03-04T18:47:26Z)
• MOSAIC: A Unified Platform for Cross-Paradigm Comparison and Evaluation of Homogeneous and Heterogeneous Multi-Agent RL, LLM, VLM, and Human Decision-Makers [8.910641383873353]
  Reinforcement learning (RL), large language models (LLMs), and vision-language models (VLMs) have been widely studied in isolation.<n>Existing infrastructure lacks the ability to deploy agents from different decision-making paradigms within the same environment.<n>We present MOSAIC, an open-source platform that bridges this gap by incorporating a diverse set of existing reinforcement learning environments.
  arXiv  Detail & Related papers  (2026-03-01T20:33:19Z)
• Composed Multi-modal Retrieval: A Survey of Approaches and Applications [81.54640206021757]
  Composed Multi-modal Retrieval (CMR) emerges as a pivotal next-generation technology.<n>CMR enables users to query images or videos by integrating a reference visual input with textual modifications.<n>This paper provides a comprehensive survey of CMR, covering its fundamental challenges, technical advancements, and applications.
  arXiv  Detail & Related papers  (2025-03-03T09:18:43Z)
• Gen-IR @ SIGIR 2023: The First Workshop on Generative Information Retrieval [32.45182506899627]
  The goal of this workshop is to focus on Generative IR techniques like document retrieval and direct Grounded Answer Generation. The format of the workshop is interactive, including roundtable and keynote sessions and tends to avoid the one-sided dialogue of a mini-conference.
  arXiv  Detail & Related papers  (2023-06-05T13:56:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.