Representation learning with a transformer by contrastive learning for money laundering detection

• URL: http://arxiv.org/abs/2507.08835v1
• Date: Mon, 07 Jul 2025 08:16:11 GMT
• Title: Representation learning with a transformer by contrastive learning for money laundering detection
• Abstract summary: A new procedure is introduced which exploits structured time series of both qualitative and quantitative data by means of a transformer neural network.<n> Experiments confirm that the transformer is able to produce general representations that succeed in exploiting money laundering patterns.<n>It also illustrates the higher ability of the new procedure for detecting nonfraudsters as well as fraudsters, while keeping the false positive rate under control.
• Score: 1.8160945635344528
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The present work tackles the money laundering detection problem. A new procedure is introduced which exploits structured time series of both qualitative and quantitative data by means of a transformer neural network. The first step of this procedure aims at learning representations of time series through contrastive learning (without any labels). The second step leverages these representations to generate a money laundering scoring of all observations. A two-thresholds approach is then introduced, which ensures a controlled false-positive rate by means of the Benjamini-Hochberg (BH) procedure. Experiments confirm that the transformer is able to produce general representations that succeed in exploiting money laundering patterns with minimal supervision from domain experts. It also illustrates the higher ability of the new procedure for detecting nonfraudsters as well as fraudsters, while keeping the false positive rate under control. This greatly contrasts with rule-based procedures or the ones based on LSTM architectures.

Related papers

• Caught in the Act(ivation): Toward Pre-Output and Multi-Turn Detection of Credential Exfiltration by LLM Agents [0.0]
  We study whether activation probes can detect credential access before output tokens are emitted.<n>Third, we treat multi-turn exfiltration as a cumulative information-flow problem.<n>Results suggest credential-exfiltration defenses should combine pre-output monitoring, canary detection, and temporal leakage accounting.
  arXiv  Detail & Related papers  (2026-06-02T18:53:17Z)
• AgentProcessBench: Diagnosing Step-Level Process Quality in Tool-Using Agents [50.481033105867205]
  We introduce AgentProcessBench, the first benchmark dedicated to evaluating step-level effectiveness in realistic, tool-augmented trajectories.<n>The benchmark comprises 1,000 diverse trajectories and 8,509 human-labeled step annotations with 89.1% inter-annotator agreement.<n>It features a ternary labeling scheme to capture exploration and an error propagation rule to reduce labeling ambiguity.
  arXiv  Detail & Related papers  (2026-03-15T16:13:58Z)
• Token Hidden Reward: Steering Exploration-Exploitation in Group Relative Deep Reinforcement Learning [64.04741347596938]
  We introduce Token Hidden Reward (THR), a token-level metric that quantifies each token's influence on the likelihood of correct responses.<n>We find that training dynamics are dominated by a small subset of tokens with high absolute THR values.<n>This insight suggests a THR-guided reweighting algorithm that modulates GRPO's learning signals to explicitly bias training toward exploitation or exploration.
  arXiv  Detail & Related papers  (2025-10-04T04:49:44Z)
• Taming Imperfect Process Verifiers: A Sampling Perspective on Backtracking [54.43083499412643]
  Test-time algorithms that combine the generative power of language models with process verifiers offer a promising lever for eliciting new reasoning capabilities.<n>We introduce a new process-guided test-time sampling algorithm, VGB, which uses theoretically grounded backtracking to achieve provably better robustness to verifier errors.
  arXiv  Detail & Related papers  (2025-10-03T16:21:14Z)
• MPOCryptoML: Multi-Pattern based Off-Chain Crypto Money Laundering Detection [2.2530496464901106]
  We propose MPOCryptoML to effectively detect multiple laundering patterns in cryptocurrency transactions.<n>MPOCryptoML includes the development of a multi-source Personalized PageRank algorithm to identify random laundering patterns.<n>We show consistent performance gains, with improvements up to 9.13% in precision, up to 10.16% in recall, up to 7.63% in F1-score, and up to 10.19% in accuracy.
  arXiv  Detail & Related papers  (2025-08-18T06:06:32Z)
• BURN: Backdoor Unlearning via Adversarial Boundary Analysis [73.14147934175604]
  Backdoor unlearning aims to remove backdoor-related information while preserving the model's original functionality.<n>We propose Backdoor Unlearning via adversaRial bouNdary analysis (BURN), a novel defense framework that integrates false correlation decoupling, progressive data refinement, and model purification.
  arXiv  Detail & Related papers  (2025-07-14T17:13:06Z)
• GARG-AML against Smurfing: A Scalable and Interpretable Graph-Based Framework for Anti-Money Laundering [1.9461779294968458]
  Money laundering is estimated to account for 2%-5% of the global GDP.<n>GARG-AML is a novel graph-based method that quantifies smurfing risk through a single interpretable metric.
  arXiv  Detail & Related papers  (2025-06-04T11:30:37Z)
• Born a Transformer -- Always a Transformer? [57.37263095476691]
  We study a family of $textitretrieval$ and $textitcopying$ tasks inspired by Liu et al.<n>We observe an $textitinduction-versus-anti-induction$ asymmetry, where pretrained models are better at retrieving tokens to the right (induction) than the left (anti-induction) of a query token.<n>Mechanistic analysis reveals that this asymmetry is connected to the differences in the strength of induction versus anti-induction circuits within pretrained transformers.
  arXiv  Detail & Related papers  (2025-05-27T21:36:50Z)
• Application of Deep Generative Models for Anomaly Detection in Complex Financial Transactions [6.168094458060399]
  This study proposes an algorithm for detecting suspicious behaviors in large payment flows based on deep generative models.<n>By combining Generative Adversarial Networks (GAN) and Variational Autoencoders (VAE), the algorithm is designed to detect abnormal behaviors in financial transactions.
  arXiv  Detail & Related papers  (2025-04-21T23:49:10Z)
• Advances in Continual Graph Learning for Anti-Money Laundering Systems: A Comprehensive Review [6.1141481450958315]
  We critically evaluate state-of-the-art continual graph learning approaches for anti-money laundering applications.<n>Our analysis demonstrates that continual learning improves model robustness and adaptability in the face of extreme class imbalances and evolving fraud patterns.
  arXiv  Detail & Related papers  (2025-03-31T16:06:47Z)
• Lazy Layers to Make Fine-Tuned Diffusion Models More Traceable [70.77600345240867]
  A novel arbitrary-in-arbitrary-out (AIAO) strategy makes watermarks resilient to fine-tuning-based removal. Unlike the existing methods of designing a backdoor for the input/output space of diffusion models, in our method, we propose to embed the backdoor into the feature space of sampled subpaths. Our empirical studies on the MS-COCO, AFHQ, LSUN, CUB-200, and DreamBooth datasets confirm the robustness of AIAO.
  arXiv  Detail & Related papers  (2024-05-01T12:03:39Z)
• Towards Accurate Guided Diffusion Sampling through Symplectic Adjoint Method [110.9458914721516]
  We propose Symplectic Adjoint Guidance (SAG), which calculates the gradient guidance in two inner stages. SAG generates images with higher qualities compared to the baselines in both guided image and video generation tasks.
  arXiv  Detail & Related papers  (2023-12-19T10:30:31Z)
• Industrial Anomaly Detection and Localization Using Weakly-Supervised Residual Transformers [44.344548601242444]
  We introduce a novel framework, Weakly-supervised RESidual Transformer (WeakREST), to achieve high anomaly detection accuracy.<n>We reformulate the pixel-wise anomaly localization task into a block-wise classification problem.<n>We develop a novel ResMixMatch algorithm, capable of handling the interplay between weak labels and residual-based representations.
  arXiv  Detail & Related papers  (2023-06-06T08:19:30Z)
• GSB: Group Superposition Binarization for Vision Transformer with Limited Training Samples [46.025105938192624]
  Vision Transformer (ViT) has performed remarkably in various computer vision tasks. ViT usually suffers from serious overfitting problems with a relatively limited number of training samples. We propose a novel model binarization technique, called Group Superposition Binarization (GSB)
  arXiv  Detail & Related papers  (2023-05-13T14:48:09Z)
• Automatic Rule Induction for Efficient Semi-Supervised Learning [56.91428251227253]
  Semi-supervised learning has shown promise in allowing NLP models to generalize from small amounts of labeled data. Pretrained transformer models act as black-box correlation engines that are difficult to explain and sometimes behave unreliably. We propose tackling both of these challenges via Automatic Rule Induction (ARI), a simple and general-purpose framework.
  arXiv  Detail & Related papers  (2022-05-18T16:50:20Z)
• TransductGAN: a Transductive Adversarial Model for Novelty Detection [4.574919718545737]
  A common setting for novelty detection is inductive whereby only examples of the negative class are available during training time. Transductive novelty detection on the other hand has only witnessed a recent surge in interest, it not only makes use of the negative class during training but also incorporates the (unlabeled) test set to detect novel examples.
  arXiv  Detail & Related papers  (2022-03-29T10:08:07Z)
• Mitigating the Mutual Error Amplification for Semi-Supervised Object Detection [92.52505195585925]
  We propose a Cross Teaching (CT) method, aiming to mitigate the mutual error amplification by introducing a rectification mechanism of pseudo labels. In contrast to existing mutual teaching methods that directly treat predictions from other detectors as pseudo labels, we propose the Label Rectification Module (LRM)
  arXiv  Detail & Related papers  (2022-01-26T03:34:57Z)
• A Time-Frequency based Suspicious Activity Detection for Anti-Money Laundering [0.0]
  Money laundering is the crucial mechanism utilized by criminals to inject proceeds of crime to the financial system. Most of the current systems in these institutions are rule-based and ineffective. This article introduces a novel feature set based on time-frequency analysis, that makes use of 2-D representations of financial transactions.
  arXiv  Detail & Related papers  (2020-11-17T08:01:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.