Results of the seventh edition of the BioASQ Challenge

• URL: http://arxiv.org/abs/2006.09174v1
• Date: Tue, 16 Jun 2020 14:23:27 GMT
• Title: Results of the seventh edition of the BioASQ Challenge
• Authors: Anastasios Nentidis, Konstantinos Bougiatiotis, Anastasia Krithara, Georgios Paliouras
• Abstract summary: The results of the seventh edition of the BioASQ challenge are presented in this paper. The aim of the BioASQ challenge is the promotion of systems and methodologies through the organization of a challenge on the tasks of large-scale biomedical semantic indexing and question answering.
• Score: 1.2617078020344616
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The results of the seventh edition of the BioASQ challenge are presented in this paper. The aim of the BioASQ challenge is the promotion of systems and methodologies through the organization of a challenge on the tasks of large-scale biomedical semantic indexing and question answering. In total, 30 teams with more than 100 systems participated in the challenge this year. As in previous years, the best systems were able to outperform the strong baselines. This suggests that state-of-the-art systems are continuously improving, pushing the frontier of research.

Related papers

• SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositories [55.161075901665946]
  Super aims to capture the realistic challenges faced by researchers working with Machine Learning (ML) and Natural Language Processing (NLP) research repositories. Our benchmark comprises three distinct problem sets: 45 end-to-end problems with annotated expert solutions, 152 sub problems derived from the expert set that focus on specific challenges, and 602 automatically generated problems for larger-scale development. We show that state-of-the-art approaches struggle to solve these problems with the best model (GPT-4o) solving only 16.3% of the end-to-end set, and 46.1% of the scenarios.
  arXiv  Detail & Related papers  (2024-09-11T17:37:48Z)
• Overview of the BioLaySumm 2024 Shared Task on the Lay Summarization of Biomedical Research Articles [21.856049605149646]
  This paper presents the setup and results of the second edition of the BioLaySumm shared task on the Lay Summarisation of Biomedical Research Articles. We aim to build on the first edition's success by further increasing research interest in this important task and encouraging participants to explore novel approaches. Overall, our results show that a broad range of innovative approaches were adopted by task participants, with a predictable shift towards the use of Large Language Models (LLMs)
  arXiv  Detail & Related papers  (2024-08-16T07:00:08Z)
• Overview of AI-Debater 2023: The Challenges of Argument Generation Tasks [62.443665295250035]
  We present the results of the AI-Debater 2023 Challenge held by the Chinese Conference on Affect Computing (CCAC 2023) In total, 32 competing teams register for the challenge, from which we received 11 successful submissions.
  arXiv  Detail & Related papers  (2024-07-20T10:13:54Z)
• The Third Monocular Depth Estimation Challenge [134.16634233789776]
  This paper discusses the results of the third edition of the Monocular Depth Estimation Challenge (MDEC) The challenge focuses on zero-shot generalization to the challenging SYNS-Patches dataset, featuring complex scenes in natural and indoor settings. The challenge winners drastically improved 3D F-Score performance, from 17.51% to 23.72%.
  arXiv  Detail & Related papers  (2024-04-25T17:59:59Z)
• The Robust Semantic Segmentation UNCV2023 Challenge Results [99.97867942388486]
  This paper outlines the winning solutions employed in addressing the MUAD uncertainty quantification challenge held at ICCV 2023. The challenge was centered around semantic segmentation in urban environments, with a particular focus on natural adversarial scenarios. The report presents the results of 19 submitted entries, with numerous techniques drawing inspiration from cutting-edge uncertainty quantification methodologies.
  arXiv  Detail & Related papers  (2023-09-27T08:20:03Z)
• Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering [0.1759008116536278]
  BioASQ is a series of challenges promoting advances in large-scale biomedical semantic indexing and question answering. This year, BioASQ consisted of new editions of the two established tasks b and Synergy, and a new task (MedProcNER) on semantic annotation of clinical content in Spanish with medical procedures. In this edition of BioASQ, 28 competing teams submitted the results of more than 150 distinct systems in total for the three different shared tasks of the challenge.
  arXiv  Detail & Related papers  (2023-07-11T09:20:33Z)
• Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering [0.16252563723817934]
  BioASQ is an ongoing series of challenges that promotes advances in the domain of large-scale biomedical semantic indexing and question answering. This year, BioASQ received more than 170 distinct systems from 38 teams in total for the four different tasks of the challenge. The majority of the competing systems outperformed the strong baselines, indicating the continuous advancement of the state-of-the-art in this domain.
  arXiv  Detail & Related papers  (2022-10-13T09:04:18Z)
• Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering [1.554739162185774]
  We present an overview of the eighth edition of the BioASQ challenge, which ran as a lab in the Conference and Labs of the Evaluation Forum (CLEF) 2020. BioASQ is a series of challenges aiming at the promotion of systems and methodologies for large-scale biomedical semantic indexing and question answering.
  arXiv  Detail & Related papers  (2021-06-28T12:24:17Z)
• Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering [0.293168019422713]
  The BioASQ challenge aims to advance the state-of-the-art in large-scale biomedical semantic indexing and question answering. This paper presents an overview of the ninth edition of the BioASQ challenge in the context of the Conference and Labs of the Evaluation Forum (CLEF) 2021. In total, 42 teams with more than 170 systems were registered to participate in the four tasks of the challenge.
  arXiv  Detail & Related papers  (2021-06-28T10:03:11Z)
• The 1st Challenge on Remote Physiological Signal Sensing (RePSS) [116.88849052951856]
  We organize the first challenge on Remote Physiological Signal Sensing (RePSS) This paper presents an overview of the challenge, including data, protocol, analysis of results and discussion.
  arXiv  Detail & Related papers  (2020-03-26T06:17:54Z)
• Analysing Affective Behavior in the First ABAW 2020 Competition [49.90617840789334]
  The Affective Behavior Analysis in-the-wild (ABAW) 2020 Competition is the first Competition aiming at automatic analysis of the three main behavior tasks. We describe this Competition, to be held in conjunction with the IEEE Conference on Face and Gesture Recognition, May 2020, in Buenos Aires, Argentina. We outline the evaluation metrics, present both the baseline system and the top-3 performing teams' methodologies per Challenge and finally present their obtained results.
  arXiv  Detail & Related papers  (2020-01-30T15:41:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.