Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024

• URL: http://arxiv.org/abs/2409.18024v1
• Date: Thu, 26 Sep 2024 16:32:10 GMT
• Title: Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024
• Authors: Timo Breuer, Christin Katharina Kreutz, Norbert Fuhr, Krisztian Balog, Philipp Schaer, Nolwenn Bernard, Ingo Frommholz, Marcel Gohsen, Kaixin Ji, Gareth J. F. Jones, Jüri Keller, Jiqun Liu, Martin Mladenov, Gabriella Pasi, Johanne Trippas, Xi Wang, Saber Zerhoudi, ChengXiang Zhai,
• Abstract summary: This paper is a report of the Workshop on Simulations for Information Access (Sim4IA) workshop at SIGIR 2024. Key takeaways were user simulation's importance in academia and industry, the possible bridging of online and offline evaluation, and the issues of organizing a companion shared task around user simulations for information access.
• Score: 33.22176229332443
• License:
• Abstract: This paper is a report of the Workshop on Simulations for Information Access (Sim4IA) workshop at SIGIR 2024. The workshop had two keynotes, a panel discussion, nine lightning talks, and two breakout sessions. Key takeaways were user simulation's importance in academia and industry, the possible bridging of online and offline evaluation, and the issues of organizing a companion shared task around user simulations for information access. We report on how we organized the workshop, provide a brief overview of what happened at the workshop, and summarize the main topics and findings of the workshop and future work.

Related papers

• Reflections from the 2024 Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistry [68.72590517877455]
  We present the outcomes from the second Large Language Model (LLM) Hackathon for Applications in Materials Science and Chemistry. The event engaged participants across global hybrid locations, resulting in 34 team submissions. The submissions spanned seven key application areas and demonstrated the diverse utility of LLMs for applications.
  arXiv  Detail & Related papers  (2024-11-20T23:08:01Z)
• Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024 [37.103230004631996]
  The aim was to bring information retrieval researchers together around the topic of LLMs for evaluation in information retrieval. Given the novelty of the topic, the workshop was focused around multi-sided discussions.
  arXiv  Detail & Related papers  (2024-08-09T23:55:58Z)
• Recent Advances, Applications, and Open Challenges in Machine Learning for Health: Reflections from Research Roundtables at ML4H 2023 Symposium [71.81297744767885]
  Third ML4H symposium was held in person on December 10, 2023, in New Orleans, Louisiana, USA. We organized eleven in-person roundtables and four virtual roundtables at ML4H 2022. This document serves as a comprehensive review paper, summarizing the recent advancements in machine learning for healthcare.
  arXiv  Detail & Related papers  (2024-03-03T22:21:58Z)
• OpenSUN3D: 1st Workshop Challenge on Open-Vocabulary 3D Scene Understanding [96.69806736025248]
  This report provides an overview of the challenge hosted at the OpenSUN3D Workshop on Open-Vocabulary 3D Scene Understanding held in conjunction with ICCV 2023.
  arXiv  Detail & Related papers  (2024-02-23T13:39:59Z)
• Findings of the First Workshop on Simulating Conversational Intelligence in Chat [29.09249285901475]
  The aim of the workshop was to bring together experts working on open-domain dialogue research. The main goal of this paper is to provide an overview of the shared task, and an in depth analysis of the shared task results following presentation at the workshop.
  arXiv  Detail & Related papers  (2024-02-09T14:08:23Z)
• Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2023): Workshop and Shared Task Report [0.8311833399935653]
  The sixth edition of the CASE workshop is held in the scope of RANLP 2023. This workshop series has been bringing together all aspects of event information collection across technical and social science fields.
  arXiv  Detail & Related papers  (2023-12-02T23:05:24Z)
• Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2022): Workshop and Shared Task Report [1.9964848378974727]
  We provide a summary of the fifth edition of the CASE workshop that is held in the scope of EMNLP 2022. This workshop has been bringing together all aspects of event information collection across technical and social science fields. In addition to the progress in depth, the submission and acceptance of multimodal approaches show the widening of this interdisciplinary research topic.
  arXiv  Detail & Related papers  (2022-11-21T11:22:32Z)
• Information Extraction and Human-Robot Dialogue towards Real-life Tasks: A Baseline Study with the MobileCS Dataset [52.22314870976088]
  The SereTOD challenge is organized and releases the MobileCS dataset, which consists of real-world dialog transcripts between real users and customer-service staffs from China Mobile. Based on the MobileCS dataset, the SereTOD challenge has two tasks, not only evaluating the construction of the dialogue system itself, but also examining information extraction from dialog transcripts. This paper mainly presents a baseline study of the two tasks with the MobileCS dataset.
  arXiv  Detail & Related papers  (2022-09-27T15:30:43Z)
• Perspectives on Sim2Real Transfer for Robotics: A Summary of the R:SS 2020 Workshop [79.20516797125704]
  This report presents the debates, posters, and discussions of the Sim2Real workshop held in conjunction with the 2020 edition of the "Robotics: Science and System" conference. 12 leaders of the field took competing debate positions on the definition, viability, and importance of transferring skills from simulation to the real world in the context of robotics problems. The debaters also joined a large panel discussion, answering audience questions and outlining the future of Sim2Real in robotics.
  arXiv  Detail & Related papers  (2020-12-07T15:48:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.