Overview of BioASQ 2024: The twelfth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering

• URL: http://arxiv.org/abs/2508.20532v1
• Date: Thu, 28 Aug 2025 08:17:57 GMT
• Title: Overview of BioASQ 2024: The twelfth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering
• Authors: Anastasios Nentidis, Georgios Katsimpras, Anastasia Krithara, Salvador Lima-López, Eulàlia Farré-Maduell, Martin Krallinger, Natalia Loukachevitch, Vera Davydova, Elena Tutubalina, Georgios Paliouras,
• Abstract summary: BioASQ is a series of international challenges promoting advances in large-scale biomedical semantic indexing and question answering.<n>This year, BioASQ consisted of new editions of the two established tasks b and Synergy, and two new tasks.<n>37 competing teams participated with more than 700 distinct submissions in total for the four different shared tasks of the challenge.
• Score: 10.703058892209683
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This is an overview of the twelfth edition of the BioASQ challenge in the context of the Conference and Labs of the Evaluation Forum (CLEF) 2024. BioASQ is a series of international challenges promoting advances in large-scale biomedical semantic indexing and question answering. This year, BioASQ consisted of new editions of the two established tasks b and Synergy, and two new tasks: a) MultiCardioNER on the adaptation of clinical entity detection to the cardiology domain in a multilingual setting, and b) BIONNE on nested NER in Russian and English. In this edition of BioASQ, 37 competing teams participated with more than 700 distinct submissions in total for the four different shared tasks of the challenge. Similarly to previous editions, most of the participating systems achieved competitive performance, suggesting the continuous advancement of the state-of-the-art in the field.

Related papers

• Overview of BioASQ 2025: The Thirteenth BioASQ Challenge on Large-Scale Biomedical Semantic Indexing and Question Answering [43.28248378868551]
  BioASQ is a series of challenges promoting advances in large-scale biomedical semantic indexing and question answering.<n>This year, BioASQ consisted of new editions of the two established tasks, b and Synergy, and four new tasks.<n>In this edition of BioASQ, 83 competing teams participated with more than 1000 distinct submissions in total.
  arXiv  Detail & Related papers  (2025-08-28T08:45:55Z)
• Biomedical Entity Linking as Multiple Choice Question Answering [48.74212158495695]
  We present BioELQA, a novel model that treats Biomedical Entity Linking as Multiple Choice Question Answering. We first obtains candidate entities with a fast retriever, jointly presents the mention and candidate entities to a generator, and then outputs the predicted symbol associated with its chosen entity. To improve generalization for long-tailed entities, we retrieve similar labeled training instances as clues and the input with retrieved instances for the generator.
  arXiv  Detail & Related papers  (2024-02-23T08:40:38Z)
• ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab [67.24684071577211]
  The challenge of replicating research results has posed a significant impediment to the field of molecular biology. We first curate a comprehensive multimodal dataset, named ProBio, as an initial step towards this objective. Next, we devise two challenging benchmarks, transparent solution tracking and multimodal action recognition, to emphasize the unique characteristics and difficulties associated with activity understanding in BioLab settings.
  arXiv  Detail & Related papers  (2023-11-01T14:44:01Z)
• Overview of BioASQ 2023: The eleventh BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering [0.1759008116536278]
  BioASQ is a series of challenges promoting advances in large-scale biomedical semantic indexing and question answering. This year, BioASQ consisted of new editions of the two established tasks b and Synergy, and a new task (MedProcNER) on semantic annotation of clinical content in Spanish with medical procedures. In this edition of BioASQ, 28 competing teams submitted the results of more than 150 distinct systems in total for the three different shared tasks of the challenge.
  arXiv  Detail & Related papers  (2023-07-11T09:20:33Z)
• The KiTS21 Challenge: Automatic segmentation of kidneys, renal tumors, and renal cysts in corticomedullary-phase CT [50.41526598153698]
  This paper presents the challenge report for the 2021 Kidney and Kidney Tumor Challenge (KiTS21) KiTS21 is a sequel to its first edition in 2019, and it features a variety of innovations in how the challenge was designed. The top-performing teams achieved a significant improvement over the state of the art set in 2019, and this performance is shown to inch ever closer to human-level performance.
  arXiv  Detail & Related papers  (2023-07-05T02:00:14Z)
• Overview of BioASQ 2022: The tenth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering [0.16252563723817934]
  BioASQ is an ongoing series of challenges that promotes advances in the domain of large-scale biomedical semantic indexing and question answering. This year, BioASQ received more than 170 distinct systems from 38 teams in total for the four different tasks of the challenge. The majority of the competing systems outperformed the strong baselines, indicating the continuous advancement of the state-of-the-art in this domain.
  arXiv  Detail & Related papers  (2022-10-13T09:04:18Z)
• LED down the rabbit hole: exploring the potential of global attention for biomedical multi-document summarisation [59.307534363825816]
  We adapt PRIMERA to the biomedical domain by placing global attention on important biomedical entities. We analyse the outputs of the 23 resulting models, and report patterns in the results related to the presence of additional global attention.
  arXiv  Detail & Related papers  (2022-09-19T01:13:42Z)
• NTIRE 2021 Multi-modal Aerial View Object Classification Challenge [88.89190054948325]
  We introduce the first Challenge on Multi-modal Aerial View Object Classification (MAVOC) in conjunction with the NTIRE 2021 workshop at CVPR. This challenge is composed of two different tracks using EO and SAR imagery. We discuss the top methods submitted for this competition and evaluate their results on our blind test set.
  arXiv  Detail & Related papers  (2021-07-02T16:55:08Z)
• Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering [1.554739162185774]
  We present an overview of the eighth edition of the BioASQ challenge, which ran as a lab in the Conference and Labs of the Evaluation Forum (CLEF) 2020. BioASQ is a series of challenges aiming at the promotion of systems and methodologies for large-scale biomedical semantic indexing and question answering.
  arXiv  Detail & Related papers  (2021-06-28T12:24:17Z)
• Overview of BioASQ 2021: The ninth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answering [0.293168019422713]
  The BioASQ challenge aims to advance the state-of-the-art in large-scale biomedical semantic indexing and question answering. This paper presents an overview of the ninth edition of the BioASQ challenge in the context of the Conference and Labs of the Evaluation Forum (CLEF) 2021. In total, 42 teams with more than 170 systems were registered to participate in the four tasks of the challenge.
  arXiv  Detail & Related papers  (2021-06-28T10:03:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.