Embedding-Aware Feature Discovery: Bridging Latent Representations and Interpretable Features in Event Sequences

• URL: http://arxiv.org/abs/2603.15713v1
• Date: Mon, 16 Mar 2026 14:29:26 GMT
• Title: Embedding-Aware Feature Discovery: Bridging Latent Representations and Interpretable Features in Event Sequences
• Abstract summary: Industrial financial systems operate on temporal event sequences such as transactions, user actions, and system logs.<n>We introduce Embedding-Aware Feature Discovery (EAFD), a unified framework that bridges the gap between learned embeddings and feature-based pipelines.<n>EAFD iteratively discovers, evaluates, and refines features directly from raw event sequences using two complementary criteria.
• Score: 5.03287845497428
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Industrial financial systems operate on temporal event sequences such as transactions, user actions, and system logs. While recent research emphasizes representation learning and large language models, production systems continue to rely heavily on handcrafted statistical features due to their interpretability, robustness under limited supervision, and strict latency constraints. This creates a persistent disconnect between learned embeddings and feature-based pipelines. We introduce Embedding-Aware Feature Discovery (EAFD), a unified framework that bridges this gap by coupling pretrained event-sequence embeddings with a self-reflective LLM-driven feature generation agent. EAFD iteratively discovers, evaluates, and refines features directly from raw event sequences using two complementary criteria: \emph{alignment}, which explains information already encoded in embeddings, and \emph{complementarity}, which identifies predictive signals missing from them. Across both open-source and industrial transaction benchmarks, EAFD consistently outperforms embedding-only and feature-based baselines, achieving relative gains of up to $+5.8\%$ over state-of-the-art pretrained embeddings, resulting in new state-of-the-art performance across event-sequence datasets.

Related papers

• FINESSE: An Agent-Based Simulator and Benchmark Dataset for Multimodal Financial Event Sequences [5.196101726931601]
  FINESSE is an agent-based simulation framework for generating synthetic, structured datasets composed of multiple interdependent event streams.<n> FINESSE-Bench is a benchmark dataset generated by the simulator, supporting four representative tasks.<n>We report baseline results using methods from time series forecasting, event sequence modeling, temporal graphs, and temporal point processes.
  arXiv  Detail & Related papers  (2026-09-09T20:24:09Z)
• From Sequence to Structure: Relational Uncertainty Propagation for LLM Agents [75.69180947909148]
  We propose a trajectory-level UQ framework for large language model (LLM) agents.<n>RuPA represents an execution history as a directed trajectory graph in which reasoning states, tool interactions, and environment feedback are nodes connected by temporal and semantic dependency edges.<n>We evaluate RUPA on representative agent benchmarks, including $$-2, Terminal-Bench-2, and GAIA, using 6 open-source LLMs spanning multiple model families.
  arXiv  Detail & Related papers  (2026-08-17T01:40:14Z)
• Formal Verification of Agentic Systems over Operational Data [59.98246281888422]
  Agentic systems driven by large language models (LLMs) are increasingly deployed in real-world where they act on persistent operational data.<n>Existing approaches do not provide such system-level guarantees.<n>We study here the verification of agentic systems comprising a single LLM and a tool orchestration harness over relational operational data.
  arXiv  Detail & Related papers  (2026-08-04T13:01:30Z)
• REAL-OW: Rehearsal-free Open World Object Detection with Low-Rank Adaptation and Dual-Stage Objectness Modeling [56.888597798431704]
  Open-World Object Detection (OWOD) requires detectors to identify previously unseen objects as unknown and incrementally incorporate them into the set of known categories.<n>Existing frameworks rely heavily on exemplar replay to mitigate catastrophic forgetting, but in some real applications, storing raw data conflicts with data access restrictions and leads to data exposure risks.<n>We propose REAL-OW, a novel rehearsal-free framework that decouples incremental knowledge through a collaborative adapter architecture.
  arXiv  Detail & Related papers  (2026-07-03T06:38:54Z)
• Generating Logically Consistent Synthetic Supply Chain Data with LLM-Driven Knowledge Graph Reasoning [51.78065387034195]
  This paper introduces textbftextitTabKG, a knowledge-graph-guided framework for logically consistent synthetic supply chain data generation.
  arXiv  Detail & Related papers  (2026-05-26T10:41:37Z)
• Monitoring Data-aware Temporal Properties (Extended Version) [56.386411908764494]
  We consider anticipatory monitoring of linear-time properties enriched with an arbitrary SMT theory over finite traces.<n>Anticipatory monitoring in this setting is highly challenging, as the monitoring state depends on both the trace prefix seen so far and all its possible finite continuations.<n>We present and formally prove the correctness of a novel foundational framework for monitoring properties in an expressive fragment offMT.
  arXiv  Detail & Related papers  (2026-05-14T10:23:11Z)
• Conditional Imputation for Within-Modality Missingness in Multi-Modal Federated Learning [8.35064965629059]
  Multimodal Federated Learning (MMFL) enables privacy-preserving collaborative training.<n>Real-world clinical applications often suffer from within-modality missingness caused by sensor intermittency or irregular sampling.<n>We propose CondI, a framework explicitly addressing this missingness using conditional diffusion models.
  arXiv  Detail & Related papers  (2026-04-25T02:35:08Z)
• IMPACT: A Dataset for Multi-Granularity Human Procedural Action Understanding in Industrial Assembly [79.737814043505]
  IMPACT is a synchronized five-view RGB-D dataset for deployment-oriented industrial procedural understanding.<n>It is built around real assembly and disassembly of a commercial angle grinder with professional-grade tools.
  arXiv  Detail & Related papers  (2026-04-12T02:09:19Z)
• ARTIS: Agentic Risk-Aware Test-Time Scaling via Iterative Simulation [72.78362530982109]
  ARTIS, Agentic Risk-Aware Test-Time Scaling via Iterative Simulation, is a framework that decouples exploration from commitment.<n>We show that naive LLM-based simulators struggle to capture rare but high-impact failure modes.<n>We introduce a risk-aware tool simulator that emphasizes fidelity on failure-inducing actions.
  arXiv  Detail & Related papers  (2026-02-02T06:33:22Z)
• GLOW: Graph-Language Co-Reasoning for Agentic Workflow Performance Prediction [51.83437071408662]
  We propose GLOW, a unified framework for AW performance prediction.<n>GLOW combines the graph-structure modeling capabilities of GNNs with the reasoning power of LLMs.<n>Experiments on FLORA-Bench show that GLOW outperforms state-of-the-art baselines in prediction accuracy and ranking utility.
  arXiv  Detail & Related papers  (2025-12-11T13:30:46Z)
• Reflective Agreement: Combining Self-Mixture of Agents with a Sequence Tagger for Robust Event Extraction [9.746352647419345]
  Event Extraction involves automatically identifying and extracting structured information about events from unstructured text.<n>We propose a hybrid approach combining a Self Mixture of Agents with a discriminative sequence tagger.<n>Experiments demonstrate our approach outperforms existing state-of-the-art event extraction methods across three benchmark datasets.
  arXiv  Detail & Related papers  (2025-08-26T18:36:23Z)
• LATTE: Learning Aligned Transactions and Textual Embeddings for Bank Clients [0.6106535351521803]
  We propose LATTE, a contrastive learning framework that aligns raw event embeddings with semantic embeddings from frozen language models.<n>We experimentally show that our method outperforms state-of-the-art techniques for learning event sequence representations on real-world financial datasets.
  arXiv  Detail & Related papers  (2025-08-07T16:46:38Z)
• DLF: Enhancing Explicit-Implicit Interaction via Dynamic Low-Order-Aware Fusion for CTR Prediction [71.41414150295702]
  We propose a novel framework, Dynamic Low-Order-Aware Fusion (DLF), for modeling click-through rate (CTR) prediction.<n>RLI preserves low-order signals while mitigating redundancy from residual connections, and NAF dynamically integrates explicit and implicit representations at each layer, enhancing information sharing.<n>Experiments on public datasets demonstrate that DLF achieves state-of-the-art performance in CTR prediction, addressing key limitations of existing models.
  arXiv  Detail & Related papers  (2025-05-25T15:05:00Z)
• CSE-SFP: Enabling Unsupervised Sentence Representation Learning via a Single Forward Pass [3.0566617373924325]
  Recent advances in pre-trained language models (PLMs) have driven remarkable progress in this field.<n>We propose CSE-SFP, an innovative method that exploits the structural characteristics of generative models.<n>We show that CSE-SFP not only produces higher-quality embeddings but also significantly reduces both training time and memory consumption.
  arXiv  Detail & Related papers  (2025-05-01T08:27:14Z)
• Breaking Determinism: Fuzzy Modeling of Sequential Recommendation Using Discrete State Space Diffusion Model [66.91323540178739]
  Sequential recommendation (SR) aims to predict items that users may be interested in based on their historical behavior. We revisit SR from a novel information-theoretic perspective and find that sequential modeling methods fail to adequately capture randomness and unpredictability of user behavior. Inspired by fuzzy information processing theory, this paper introduces the fuzzy sets of interaction sequences to overcome the limitations and better capture the evolution of users' real interests.
  arXiv  Detail & Related papers  (2024-10-31T14:52:01Z)
• WSSOD: A New Pipeline for Weakly- and Semi-Supervised Object Detection [75.80075054706079]
  We propose a weakly- and semi-supervised object detection framework (WSSOD) An agent detector is first trained on a joint dataset and then used to predict pseudo bounding boxes on weakly-annotated images. The proposed framework demonstrates remarkable performance on PASCAL-VOC and MSCOCO benchmark, achieving a high performance comparable to those obtained in fully-supervised settings.
  arXiv  Detail & Related papers  (2021-05-21T11:58:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.