UNIMIB at TREC 2021 Clinical Trials Track
- URL: http://arxiv.org/abs/2207.13514v1
- Date: Wed, 27 Jul 2022 13:39:30 GMT
- Title: UNIMIB at TREC 2021 Clinical Trials Track
- Authors: Georgios Peikos, Oscar Espitia, Gabriella Pasi
- Abstract summary: This contribution summarizes the participation of the UNIMIB team to the TREC 2021 Clinical Trials Track.
We have investigated the effect of different query representations combined with several retrieval models on the retrieval performance.
- Score: 2.840363325289377
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: This contribution summarizes the participation of the UNIMIB team to the TREC
2021 Clinical Trials Track. We have investigated the effect of different query
representations combined with several retrieval models on the retrieval
performance. First, we have implemented a neural re-ranking approach to study
the effectiveness of dense text representations. Additionally, we have
investigated the effectiveness of a novel decision-theoretic model for
relevance estimation. Finally, both of the above relevance models have been
compared with standard retrieval approaches. In particular, we combined a
keyword extraction method with a standard retrieval process based on the BM25
model and a decision-theoretic relevance model that exploits the
characteristics of this particular search task. The obtained results show that
the proposed keyword extraction method improves 84% of the queries over the
TREC's median NDCG@10 measure when combined with either traditional or
decision-theoretic relevance models. Moreover, regarding RPEC@10, the employed
decision-theoretic model improves 85% of the queries over the reported TREC's
median value.
Related papers
- Revisiting BPR: A Replicability Study of a Common Recommender System Baseline [78.00363373925758]
We study the features of the BPR model, indicating their impact on its performance, and investigate open-source BPR implementations.
Our analysis reveals inconsistencies between these implementations and the original BPR paper, leading to a significant decrease in performance of up to 50% for specific implementations.
We show that the BPR model can achieve performance levels close to state-of-the-art methods on the top-n recommendation tasks and even outperform them on specific datasets.
arXiv Detail & Related papers (2024-09-21T18:39:53Z) - Towards Efficient Patient Recruitment for Clinical Trials: Application of a Prompt-Based Learning Model [0.7373617024876725]
Clinical trials are essential for advancing pharmaceutical interventions, but they face a bottleneck in selecting eligible participants.
The complex nature of unstructured medical texts presents challenges in efficiently identifying participants.
In this study, we aimed to evaluate the performance of a prompt-based large language model for the cohort selection task.
arXiv Detail & Related papers (2024-04-24T20:42:28Z) - Hybrid Representation-Enhanced Sampling for Bayesian Active Learning in
Musculoskeletal Segmentation of Lower Extremities [0.9287179270753105]
This study introduces a hybrid representation-enhanced sampling strategy that integrates both density and diversity criteria.
Experiments are performed on two lower extremity (LE) datasets of MRI and CT images.
arXiv Detail & Related papers (2023-07-26T06:52:29Z) - Effective Matching of Patients to Clinical Trials using Entity
Extraction and Neural Re-ranking [8.200196331837576]
Clinical trials (CTs) often fail due to inadequate patient recruitment.
This paper tackles the challenges of CT retrieval by presenting an approach that addresses the patient-to-trials paradigm.
arXiv Detail & Related papers (2023-07-01T16:42:39Z) - Clinical Concept and Relation Extraction Using Prompt-based Machine
Reading Comprehension [38.79665143111312]
We formulate both clinical concept extraction and relation extraction using a unified prompt-based machine reading comprehension architecture.
We compare our MRC models with existing deep learning models for concept extraction and end-to-end relation extraction.
We evaluate the transfer learning ability of the proposed MRC models in a cross-institution setting.
arXiv Detail & Related papers (2023-03-14T22:37:31Z) - Less is More: Mitigate Spurious Correlations for Open-Domain Dialogue
Response Generation Models by Causal Discovery [52.95935278819512]
We conduct the first study on spurious correlations for open-domain response generation models based on a corpus CGDIALOG curated in our work.
Inspired by causal discovery algorithms, we propose a novel model-agnostic method for training and inference of response generation model.
arXiv Detail & Related papers (2023-03-02T06:33:48Z) - In Search of Insights, Not Magic Bullets: Towards Demystification of the
Model Selection Dilemma in Heterogeneous Treatment Effect Estimation [92.51773744318119]
This paper empirically investigates the strengths and weaknesses of different model selection criteria.
We highlight that there is a complex interplay between selection strategies, candidate estimators and the data used for comparing them.
arXiv Detail & Related papers (2023-02-06T16:55:37Z) - RoBLEURT Submission for the WMT2021 Metrics Task [72.26898579202076]
We present our submission to the Shared Metrics Task: RoBLEURT.
Our model reaches state-of-the-art correlations with the WMT 2020 human annotations upon 8 out of 10 to-English language pairs.
arXiv Detail & Related papers (2022-04-28T08:49:40Z) - A multi-stage machine learning model on diagnosis of esophageal
manometry [50.591267188664666]
The framework includes deep-learning models at the swallow-level stage and feature-based machine learning models at the study-level stage.
This is the first artificial-intelligence-style model to automatically predict CC diagnosis of HRM study from raw multi-swallow data.
arXiv Detail & Related papers (2021-06-25T20:09:23Z) - Adversarial Sample Enhanced Domain Adaptation: A Case Study on
Predictive Modeling with Electronic Health Records [57.75125067744978]
We propose a data augmentation method to facilitate domain adaptation.
adversarially generated samples are used during domain adaptation.
Results confirm the effectiveness of our method and the generality on different tasks.
arXiv Detail & Related papers (2021-01-13T03:20:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.