Token Entropy Regularization for Multi-modal Antenna Affiliation Identification

• URL: http://arxiv.org/abs/2601.21280v2
• Date: Fri, 30 Jan 2026 12:09:31 GMT
• Title: Token Entropy Regularization for Multi-modal Antenna Affiliation Identification
• Authors: Dong Chen, Ruoyu Li, Xinyan Zhang, Jialei Xu, Ruosen Zhao, Zhikang Zhang, Lingyun Li, Zizhuang Wei,
• Abstract summary: Current practice relies on the cumbersome and error-prone process of manual tower inspections.<n>We propose a novel paradigm shift that fuses video footage of base stations, antenna geometric features, and Physical Cell Identity ( PCI) signals.<n>To tackle the representation alignment challenge, we propose a novel Token Entropy Regularization module in the pretraining stage.
• Score: 11.148193639936407
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Accurate antenna affiliation identification is crucial for optimizing and maintaining communication networks. Current practice, however, relies on the cumbersome and error-prone process of manual tower inspections. We propose a novel paradigm shift that fuses video footage of base stations, antenna geometric features, and Physical Cell Identity (PCI) signals, transforming antenna affiliation identification into multi-modal classification and matching tasks. Publicly available pretrained transformers struggle with this unique task due to a lack of analogous data in the communications domain, which hampers cross-modal alignment. To address this, we introduce a dedicated training framework that aligns antenna images with corresponding PCI signals. To tackle the representation alignment challenge, we propose a novel Token Entropy Regularization module in the pretraining stage. Our experiments demonstrate that TER accelerates convergence and yields significant performance gains. Further analysis reveals that the entropy of the first token is modality-dependent. Code will be made available upon publication.

Related papers

• PLA for Drone RID Frames via Motion Estimation and Consistency Verification [12.735651073414452]
  Drone Remote Identification (RID) plays a critical role in low-altitude airspace supervision.<n>Lack of cryptographic protection makes it vulnerable to spoofing and replay attacks.<n>We propose a consistency verification-based physical-layer authentication (PLA) algorithm for drone RID frames.
  arXiv  Detail & Related papers  (2026-02-27T07:37:34Z)
• SMKC: Sketch Based Kernel Correlation Images for Variable Cardinality Time Series Anomaly Detection [0.0]
  In operational environments, monitoring systems frequently experience sensor churn.<n>We propose SMKC, a framework that decouples the dynamic input structure from the anomaly detector.<n>We find that a detector using random projections and nearest neighbors on the SMKC representation performs competitively with fully trained baselines.
  arXiv  Detail & Related papers  (2026-01-28T21:15:11Z)
• Deep Learning Optimization of Two-State Pinching Antennas Systems [48.70043547158868]
  Pinching antennas (PAs) can dynamically control electromagnetic wave propagation through binary activation states.<n>In this work, we investigate the problem of optimally selecting a subset of fixed-position PAs to activate in a waveguide, when the aim is to maximize the communication rate at a user terminal.
  arXiv  Detail & Related papers  (2025-07-08T17:55:54Z)
• PCA-Featured Transformer for Jamming Detection in 5G UAV Networks [0.5999777817331317]
  Unmanned Aerial Vehicles (UAVs) face significant security risks from jamming attacks, which can compromise network functionality.<n>Traditional detection methods often fall short when confronting AI-powered jamming that dynamically modifies its behavior.<n>We introduce a novel U-shaped transformer architecture to refine feature representations for improved wireless security.
  arXiv  Detail & Related papers  (2024-12-19T16:13:04Z)
• Multi-Source and Test-Time Domain Adaptation on Multivariate Signals using Spatio-Temporal Monge Alignment [59.75420353684495]
  Machine learning applications on signals such as computer vision or biomedical data often face challenges due to the variability that exists across hardware devices or session recordings. In this work, we propose Spatio-Temporal Monge Alignment (STMA) to mitigate these variabilities. We show that STMA leads to significant and consistent performance gains between datasets acquired with very different settings.
  arXiv  Detail & Related papers  (2024-07-19T13:33:38Z)
• Multi-task Learning for Radar Signal Characterisation [48.265859815346985]
  This paper presents an approach for tackling radar signal classification and characterisation as a multi-task learning (MTL) problem. We propose the IQ Signal Transformer (IQST) among several reference architectures that allow for simultaneous optimisation of multiple regression and classification tasks. We demonstrate the performance of our proposed MTL model on a synthetic radar dataset, while also providing a first-of-its-kind benchmark for radar signal characterisation.
  arXiv  Detail & Related papers  (2023-06-19T12:01:28Z)
• Antenna Array Calibration Via Gaussian Process Models [0.0]
  Antenna array calibration is necessary to maintain the high fidelity of beam patterns across a wide range of advanced antenna systems. We formulate antenna calibration in an alternative way, namely as a task of functional approximation, and address it via Bayesian machine learning. Our contributions are three-fold. Firstly, we define a parameter space, that captures the underlying hardware impairments corresponding to each radiating element, their positional offsets, as well as the mutual coupling effects between antenna elements. Once deployed, the learned non-parametric models effectively serve to continuously transform the beamforming weights of the system, resulting in corrected beam patterns.
  arXiv  Detail & Related papers  (2023-01-16T19:40:50Z)
• High-Performance Transformer Tracking [74.07751002861802]
  We present a Transformer tracking (named TransT) method based on the Siamese-like feature extraction backbone, the designed attention-based fusion mechanism, and the classification and regression head. Experiments show that our TransT and TransT-M methods achieve promising results on seven popular datasets.
  arXiv  Detail & Related papers  (2022-03-25T09:33:29Z)
• Multi-task Learning Approach for Modulation and Wireless Signal Classification for 5G and Beyond: Edge Deployment via Model Compression [1.218340575383456]
  Future communication networks must address the scarce spectrum to accommodate growth of heterogeneous wireless devices. We exploit the potential of deep neural networks based multi-task learning framework to simultaneously learn modulation and signal classification tasks. We provide a comprehensive heterogeneous wireless signals dataset for public use.
  arXiv  Detail & Related papers  (2022-02-26T14:51:02Z)
• HyperHyperNetworks for the Design of Antenna Arrays [91.3755431537592]
  We present deep learning methods for the design of arrays and single instances of small antennas. In the case of a single antenna, the solution is based on a composite neural network that combines a simulation network, a hypernetwork, and a refinement network. The learning objective is based on measuring the similarity of the obtained radiation pattern to the desired one.
  arXiv  Detail & Related papers  (2021-05-09T05:21:28Z)
• Harnessing Wireless Channels for Scalable and Privacy-Preserving Federated Learning [56.94644428312295]
  Wireless connectivity is instrumental in enabling federated learning (FL) Channel randomnessperturbs each worker inversions model update while multiple workers updates incur significant interference on bandwidth. In A-FADMM, all workers upload their model updates to the parameter server using a single channel via analog transmissions. This not only saves communication bandwidth, but also hides each worker's exact model update trajectory from any eavesdropper.
  arXiv  Detail & Related papers  (2020-07-03T16:31:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.