Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering
- URL: http://arxiv.org/abs/2106.14618v1
- Date: Mon, 28 Jun 2021 12:24:17 GMT
- Title: Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering
- Authors: Anastasios Nentidis, Anastasia Krithara, Konstantinos Bougiatiotis,
Martin Krallinger, Carlos Rodriguez-Penagos, Marta Villegas, Georgios
Paliouras
- Abstract summary: We present an overview of the eighth edition of the BioASQ challenge, which ran as a lab in the Conference and Labs of the Evaluation Forum (CLEF) 2020.
BioASQ is a series of challenges aiming at the promotion of systems and methodologies for large-scale biomedical semantic indexing and question answering.
- Score: 1.554739162185774
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we present an overview of the eighth edition of the BioASQ
challenge, which ran as a lab in the Conference and Labs of the Evaluation
Forum (CLEF) 2020. BioASQ is a series of challenges aiming at the promotion of
systems and methodologies for large-scale biomedical semantic indexing and
question answering. To this end, shared tasks are organized yearly since 2012,
where different teams develop systems that compete on the same demanding
benchmark datasets that represent the real information needs of experts in the
biomedical domain. This year, the challenge has been extended with the
introduction of a new task on medical semantic indexing in Spanish. In total,
34 teams with more than 100 systems participated in the three tasks of the
challenge. As in previous years, the results of the evaluation reveal that the
top-performing systems managed to outperform the strong baselines, which
suggests that state-of-the-art systems keep pushing the frontier of research
through continuous improvements.
Related papers
- Capabilities of Gemini Models in Medicine [100.60391771032887]
We introduce Med-Gemini, a family of highly capable multimodal models specialized in medicine.
We evaluate Med-Gemini on 14 medical benchmarks, establishing new state-of-the-art (SoTA) performance on 10 of them.
Our results offer compelling evidence for Med-Gemini's potential, although further rigorous evaluation will be crucial before real-world deployment.
arXiv Detail & Related papers (2024-04-29T04:11:28Z) - Advancing Chinese biomedical text mining with community challenges [5.394303108735509]
This study aims to review the recent advances in community challenges for biomedical text mining in China.
We identified 39 evaluation tasks from 6 community challenges that spanned from 2017 to 2023.
arXiv Detail & Related papers (2024-03-07T06:52:51Z) - ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab [67.24684071577211]
The challenge of replicating research results has posed a significant impediment to the field of molecular biology.
We first curate a comprehensive multimodal dataset, named ProBio, as an initial step towards this objective.
Next, we devise two challenging benchmarks, transparent solution tracking and multimodal action recognition, to emphasize the unique characteristics and difficulties associated with activity understanding in BioLab settings.
arXiv Detail & Related papers (2023-11-01T14:44:01Z) - Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering [0.1759008116536278]
BioASQ is a series of challenges promoting advances in large-scale biomedical semantic indexing and question answering.
This year, BioASQ consisted of new editions of the two established tasks b and Synergy, and a new task (MedProcNER) on semantic annotation of clinical content in Spanish with medical procedures.
In this edition of BioASQ, 28 competing teams submitted the results of more than 150 distinct systems in total for the three different shared tasks of the challenge.
arXiv Detail & Related papers (2023-07-11T09:20:33Z) - The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors,
and renal cysts in corticomedullary-phase CT [50.41526598153698]
This paper presents the challenge report for the 2021 Kidney and Kidney Tumor Challenge (KiTS21)
KiTS21 is a sequel to its first edition in 2019, and it features a variety of innovations in how the challenge was designed.
The top-performing teams achieved a significant improvement over the state of the art set in 2019, and this performance is shown to inch ever closer to human-level performance.
arXiv Detail & Related papers (2023-07-05T02:00:14Z) - BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks [68.39821375903591]
Generalist AI holds the potential to address limitations due to its versatility in interpreting different data types.
Here, we propose BiomedGPT, the first open-source and lightweight vision-language foundation model.
arXiv Detail & Related papers (2023-05-26T17:14:43Z) - Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering [0.16252563723817934]
BioASQ is an ongoing series of challenges that promotes advances in the domain of large-scale biomedical semantic indexing and question answering.
This year, BioASQ received more than 170 distinct systems from 38 teams in total for the four different tasks of the challenge.
The majority of the competing systems outperformed the strong baselines, indicating the continuous advancement of the state-of-the-art in this domain.
arXiv Detail & Related papers (2022-10-13T09:04:18Z) - Lung-Originated Tumor Segmentation from Computed Tomography Scan (LOTUS)
Benchmark [48.30502612686276]
Lung cancer is one of the deadliest cancers, and its effective diagnosis and treatment depend on the accurate delineation of the tumor.
Human-centered segmentation, which is currently the most common approach, is subject to inter-observer variability.
The 2018 VIP Cup started with a global engagement from 42 countries to access the competition data.
In a nutshell, all the algorithms proposed during the competition, are based on deep learning models combined with a false positive reduction technique.
arXiv Detail & Related papers (2022-01-03T03:06:38Z) - Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale
Biomedical Semantic Indexing and Question Answering [0.293168019422713]
The BioASQ challenge aims to advance the state-of-the-art in large-scale biomedical semantic indexing and question answering.
This paper presents an overview of the ninth edition of the BioASQ challenge in the context of the Conference and Labs of the Evaluation Forum (CLEF) 2021.
In total, 42 teams with more than 170 systems were registered to participate in the four tasks of the challenge.
arXiv Detail & Related papers (2021-06-28T10:03:11Z) - Results of the seventh edition of the BioASQ Challenge [1.2617078020344616]
The results of the seventh edition of the BioASQ challenge are presented in this paper.
The aim of the BioASQ challenge is the promotion of systems and methodologies through the organization of a challenge on the tasks of large-scale biomedical semantic indexing and question answering.
arXiv Detail & Related papers (2020-06-16T14:23:27Z) - Analysing Affective Behavior in the First ABAW 2020 Competition [49.90617840789334]
The Affective Behavior Analysis in-the-wild (ABAW) 2020 Competition is the first Competition aiming at automatic analysis of the three main behavior tasks.
We describe this Competition, to be held in conjunction with the IEEE Conference on Face and Gesture Recognition, May 2020, in Buenos Aires, Argentina.
We outline the evaluation metrics, present both the baseline system and the top-3 performing teams' methodologies per Challenge and finally present their obtained results.
arXiv Detail & Related papers (2020-01-30T15:41:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.