Efficient Retrieval of Temporal Event Sequences from Textual Descriptions

• URL: http://arxiv.org/abs/2410.14043v1
• Date: Thu, 17 Oct 2024 21:35:55 GMT
• Title: Efficient Retrieval of Temporal Event Sequences from Textual Descriptions
• Authors: Zefang Liu, Yinzhu Quan,
• Abstract summary: TPP-LLM-Embedding is a unified model for embedding and retrieving event sequences based on natural language descriptions. Our model encodes both event types and times, generating a sequence-level representation through pooling. TPP-LLM-Embedding enables efficient retrieval and demonstrates superior performance compared to baseline models across diverse datasets.
• Score: 0.0
• License:
• Abstract: Retrieving temporal event sequences from textual descriptions is essential for applications such as analyzing e-commerce behavior, monitoring social media activities, and tracking criminal incidents. In this paper, we introduce TPP-LLM-Embedding, a unified model for efficiently embedding and retrieving event sequences based on natural language descriptions. Built on the TPP-LLM framework, which integrates large language models with temporal point processes, our model encodes both event types and times, generating a sequence-level representation through pooling. Textual descriptions are embedded using the same architecture, ensuring a shared embedding space for both sequences and descriptions. We optimize a contrastive loss based on similarity between these embeddings, bringing matching pairs closer and separating non-matching ones. TPP-LLM-Embedding enables efficient retrieval and demonstrates superior performance compared to baseline models across diverse datasets.

Related papers

• TPP-LLM: Modeling Temporal Point Processes by Efficiently Fine-Tuning Large Language Models [0.0]
  Temporal point processes (TPPs) are widely used to model the timing and occurrence of events in domains such as social networks, transportation systems, and e-commerce. We introduce TPP-LLM, a novel framework that integrates large language models (LLMs) with TPPs to capture both the semantic and temporal aspects of event sequences.
  arXiv  Detail & Related papers  (2024-10-02T22:17:24Z)
• Frame Order Matters: A Temporal Sequence-Aware Model for Few-Shot Action Recognition [14.97527336050901]
  We propose a novel Temporal Sequence-Aware Model (TSAM) for few-shot action recognition (FSAR) It incorporates a sequential perceiver adapter into the pre-training framework, to integrate both the spatial information and the sequential temporal dynamics into the feature embeddings. Experimental results on five FSAR datasets demonstrate that our method set a new benchmark, beating the second-best competitors with large margins.
  arXiv  Detail & Related papers  (2024-08-22T15:13:27Z)
• Analyzing Temporal Complex Events with Large Language Models? A Benchmark towards Temporal, Long Context Understanding [57.62275091656578]
  We refer to the complex events composed of many news articles over an extended period as Temporal Complex Event (TCE) This paper proposes a novel approach using Large Language Models (LLMs) to systematically extract and analyze the event chain within TCE.
  arXiv  Detail & Related papers  (2024-06-04T16:42:17Z)
• TacoERE: Cluster-aware Compression for Event Relation Extraction [47.89154684352463]
  Event relation extraction is a critical and fundamental challenge for natural language processing. We propose a cluster-aware compression method for improving event relation extraction (TacoERE)
  arXiv  Detail & Related papers  (2024-05-11T03:06:08Z)
• FLIP: Fine-grained Alignment between ID-based Models and Pretrained Language Models for CTR Prediction [49.510163437116645]
  Click-through rate (CTR) prediction plays as a core function module in personalized online services. Traditional ID-based models for CTR prediction take as inputs the one-hot encoded ID features of tabular modality. Pretrained Language Models(PLMs) has given rise to another paradigm, which takes as inputs the sentences of textual modality. We propose to conduct Fine-grained feature-level ALignment between ID-based Models and Pretrained Language Models(FLIP) for CTR prediction.
  arXiv  Detail & Related papers  (2023-10-30T11:25:03Z)
• IDRNet: Intervention-Driven Relation Network for Semantic Segmentation [34.09179171102469]
  Co-occurrent visual patterns suggest that pixel relation modeling facilitates dense prediction tasks. Despite the impressive results, existing paradigms often suffer from inadequate or ineffective contextual information aggregation. We propose a novel textbfIntervention-textbfDriven textbfRelation textbfNetwork.
  arXiv  Detail & Related papers  (2023-10-16T18:37:33Z)
• Enhancing Asynchronous Time Series Forecasting with Contrastive Relational Inference [21.51753838306655]
  Temporal point processes(TPPs) are the standard method for modeling such. Existing TPP models have focused on the conditional distribution of future events instead of explicitly modeling event interactions, imposing challenges for event predictions. We propose a novel approach that leverages a Neural Inference (NRI) to learn a graph that infers interactions while simultaneously learning dynamics patterns from observational data.
  arXiv  Detail & Related papers  (2023-09-06T09:47:03Z)
• Semantic Structure Enhanced Event Causality Identification [57.26259734944247]
  Event Causality Identification (ECI) aims to identify causal relations between events in unstructured texts. Existing methods underestimate two kinds of semantic structures vital to the ECI task, namely, event-centric structure and event-associated structure.
  arXiv  Detail & Related papers  (2023-05-22T07:42:35Z)
• CLIP-Event: Connecting Text and Images with Event Structures [123.31452120399827]
  We propose a contrastive learning framework to enforce vision-language pretraining models. We take advantage of text information extraction technologies to obtain event structural knowledge. Experiments show that our zero-shot CLIP-Event outperforms the state-of-the-art supervised model in argument extraction.
  arXiv  Detail & Related papers  (2022-01-13T17:03:57Z)
• Topic Detection and Tracking with Time-Aware Document Embeddings [23.348627263872842]
  We design a neural method that fuses temporal and textual information into a single representation of news documents for event detection. In the retrospective setting, we apply clustering algorithms to the time-aware embeddings and show substantial improvements over baselines on the News2013 data set. In the online streaming setting, we add our document encoder to an existing state-of-the-art TDT pipeline and demonstrate that it can benefit the overall performance.
  arXiv  Detail & Related papers  (2021-12-12T06:25:15Z)
• Team RUC_AIM3 Technical Report at Activitynet 2020 Task 2: Exploring Sequential Events Detection for Dense Video Captioning [63.91369308085091]
  We propose a novel and simple model for event sequence generation and explore temporal relationships of the event sequence in the video. The proposed model omits inefficient two-stage proposal generation and directly generates event boundaries conditioned on bi-directional temporal dependency in one pass. The overall system achieves state-of-the-art performance on the dense-captioning events in video task with 9.894 METEOR score on the challenge testing set.
  arXiv  Detail & Related papers  (2020-06-14T13:21:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.