Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering
- URL: http://arxiv.org/abs/2307.05131v1
- Date: Tue, 11 Jul 2023 09:20:33 GMT
- Title: Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering
- Authors: Anastasios Nentidis, Georgios Katsimpras, Anastasia Krithara, Salvador
Lima L\'opez, Eul\'alia Farr\'e-Maduell, Luis Gasco, Martin Krallinger,
Georgios Paliouras
- Abstract summary: BioASQ is a series of challenges promoting advances in large-scale biomedical semantic indexing and question answering.
This year, BioASQ consisted of new editions of the two established tasks b and Synergy, and a new task (MedProcNER) on semantic annotation of clinical content in Spanish with medical procedures.
In this edition of BioASQ, 28 competing teams submitted the results of more than 150 distinct systems in total for the three different shared tasks of the challenge.
- Score: 0.1759008116536278
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This is an overview of the eleventh edition of the BioASQ challenge in the
context of the Conference and Labs of the Evaluation Forum (CLEF) 2023. BioASQ
is a series of international challenges promoting advances in large-scale
biomedical semantic indexing and question answering. This year, BioASQ
consisted of new editions of the two established tasks b and Synergy, and a new
task (MedProcNER) on semantic annotation of clinical content in Spanish with
medical procedures, which have a critical role in medical practice. In this
edition of BioASQ, 28 competing teams submitted the results of more than 150
distinct systems in total for the three different shared tasks of the
challenge. Similarly to previous editions, most of the participating systems
achieved competitive performance, suggesting the continuous advancement of the
state-of-the-art in the field.
Related papers
- Overview of the BioLaySumm 2024 Shared Task on the Lay Summarization of Biomedical Research Articles [21.856049605149646]
This paper presents the setup and results of the second edition of the BioLaySumm shared task on the Lay Summarisation of Biomedical Research Articles.
We aim to build on the first edition's success by further increasing research interest in this important task and encouraging participants to explore novel approaches.
Overall, our results show that a broad range of innovative approaches were adopted by task participants, with a predictable shift towards the use of Large Language Models (LLMs)
arXiv Detail & Related papers (2024-08-16T07:00:08Z) - ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab [67.24684071577211]
The challenge of replicating research results has posed a significant impediment to the field of molecular biology.
We first curate a comprehensive multimodal dataset, named ProBio, as an initial step towards this objective.
Next, we devise two challenging benchmarks, transparent solution tracking and multimodal action recognition, to emphasize the unique characteristics and difficulties associated with activity understanding in BioLab settings.
arXiv Detail & Related papers (2023-11-01T14:44:01Z) - The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors,
and renal cysts in corticomedullary-phase CT [50.41526598153698]
This paper presents the challenge report for the 2021 Kidney and Kidney Tumor Challenge (KiTS21)
KiTS21 is a sequel to its first edition in 2019, and it features a variety of innovations in how the challenge was designed.
The top-performing teams achieved a significant improvement over the state of the art set in 2019, and this performance is shown to inch ever closer to human-level performance.
arXiv Detail & Related papers (2023-07-05T02:00:14Z) - BiomedCLIP: a multimodal biomedical foundation model pretrained from
fifteen million scientific image-text pairs [48.376109878173956]
We present PMC-15M, a novel dataset that is two orders of magnitude larger than existing biomedical multimodal datasets.
PMC-15M contains 15 million biomedical image-text pairs collected from 4.4 million scientific articles.
Based on PMC-15M, we have pretrained BiomedCLIP, a multimodal foundation model, with domain-specific adaptations tailored to biomedical vision-language processing.
arXiv Detail & Related papers (2023-03-02T02:20:04Z) - Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering [0.16252563723817934]
BioASQ is an ongoing series of challenges that promotes advances in the domain of large-scale biomedical semantic indexing and question answering.
This year, BioASQ received more than 170 distinct systems from 38 teams in total for the four different tasks of the challenge.
The majority of the competing systems outperformed the strong baselines, indicating the continuous advancement of the state-of-the-art in this domain.
arXiv Detail & Related papers (2022-10-13T09:04:18Z) - LED down the rabbit hole: exploring the potential of global attention
for biomedical multi-document summarisation [59.307534363825816]
We adapt PRIMERA to the biomedical domain by placing global attention on important biomedical entities.
We analyse the outputs of the 23 resulting models, and report patterns in the results related to the presence of additional global attention.
arXiv Detail & Related papers (2022-09-19T01:13:42Z) - NTIRE 2021 Multi-modal Aerial View Object Classification Challenge [88.89190054948325]
We introduce the first Challenge on Multi-modal Aerial View Object Classification (MAVOC) in conjunction with the NTIRE 2021 workshop at CVPR.
This challenge is composed of two different tracks using EO and SAR imagery.
We discuss the top methods submitted for this competition and evaluate their results on our blind test set.
arXiv Detail & Related papers (2021-07-02T16:55:08Z) - Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering [1.554739162185774]
We present an overview of the eighth edition of the BioASQ challenge, which ran as a lab in the Conference and Labs of the Evaluation Forum (CLEF) 2020.
BioASQ is a series of challenges aiming at the promotion of systems and methodologies for large-scale biomedical semantic indexing and question answering.
arXiv Detail & Related papers (2021-06-28T12:24:17Z) - Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering [0.293168019422713]
The BioASQ challenge aims to advance the state-of-the-art in large-scale biomedical semantic indexing and question answering.
This paper presents an overview of the ninth edition of the BioASQ challenge in the context of the Conference and Labs of the Evaluation Forum (CLEF) 2021.
In total, 42 teams with more than 170 systems were registered to participate in the four tasks of the challenge.
arXiv Detail & Related papers (2021-06-28T10:03:11Z) - Domain-Specific Pretraining for Vertical Search: Case Study on
Biomedical Literature [67.4680600632232]
Self-supervised learning has emerged as a promising direction to overcome the annotation bottleneck.
We propose a general approach for vertical search based on domain-specific pretraining.
Our system can scale to tens of millions of articles on PubMed and has been deployed as Microsoft Biomedical Search.
arXiv Detail & Related papers (2021-06-25T01:02:55Z) - Results of the seventh edition of the BioASQ Challenge [1.2617078020344616]
The results of the seventh edition of the BioASQ challenge are presented in this paper.
The aim of the BioASQ challenge is the promotion of systems and methodologies through the organization of a challenge on the tasks of large-scale biomedical semantic indexing and question answering.
arXiv Detail & Related papers (2020-06-16T14:23:27Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.