Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalance
- URL: http://arxiv.org/abs/2503.00147v1
- Date: Fri, 28 Feb 2025 19:53:42 GMT
- Title: Precise Event Spotting in Sports Videos: Solving Long-Range Dependency and Class Imbalance
- Abstract summary: Event Spotting (PES) aims to identify events and their class from long, untrimmed videos, particularly in sports.<n>Existing methods mainly rely on features from a large pre-trained network, which may not be ideal for the task.<n>This paper demonstrates that an appropriately designed network, trained end-to-end, can outperform state-of-the-art (SOTA) methods.
- Score: 25.289420629683477
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Precise Event Spotting (PES) aims to identify events and their class from long, untrimmed videos, particularly in sports. The main objective of PES is to detect the event at the exact moment it occurs. Existing methods mainly rely on features from a large pre-trained network, which may not be ideal for the task. Furthermore, these methods overlook the issue of imbalanced event class distribution present in the data, negatively impacting performance in challenging scenarios. This paper demonstrates that an appropriately designed network, trained end-to-end, can outperform state-of-the-art (SOTA) methods. Particularly, we propose a network with a convolutional spatial-temporal feature extractor enhanced with our proposed Adaptive Spatio-Temporal Refinement Module (ASTRM) and a long-range temporal module. The ASTRM enhances the features with spatio-temporal information. Meanwhile, the long-range temporal module helps extract global context from the data by modeling long-range dependencies. To address the class imbalance issue, we introduce the Soft Instance Contrastive (SoftIC) loss that promotes feature compactness and class separation. Extensive experiments show that the proposed method is efficient and outperforms the SOTA methods, specifically in more challenging settings.
Related papers
- SAIL: Scene-aware Adaptive Iterative Learning for Long-Tail Trajectory Prediction in Autonomous Vehicles [22.453938678763013]
We propose a novel framework that tackles the long-tail problem by first defining and modeling trajectories across three key attribute dimensions.<n>Our approach then synergizes an attribute-guided augmentation and feature extraction process with a highly adaptive contrastive learning strategy.<n>This framework advances reliable AV trajectory prediction in real-world, mixed-autonomy settings.
arXiv Detail & Related papers (2026-04-06T10:09:24Z) - E-TIDE: Fast, Structure-Preserving Motion Forecasting from Event Sequences [2.6812215263618473]
Event-based cameras capture visual information as asynchronous streams of per-pixel brightness changes, generating sparse, temporally precise data.<n>We introduce E-TIDE, a lightweight, end-to-end trainable architecture for event-tensor prediction that is designed to operate efficiently without large-scale pretraining.
arXiv Detail & Related papers (2026-03-29T16:34:12Z) - FAIM: Frequency-Aware Interactive Mamba for Time Series Classification [87.84511960413715]
Time series classification (TSC) is crucial in numerous real-world applications, such as environmental monitoring, medical diagnosis, and posture recognition.<n>We propose FAIM, a lightweight Frequency-Aware Interactive Mamba model.<n>We show that FAIM consistently outperforms existing state-of-the-art (SOTA) methods, achieving a superior trade-off between accuracy and efficiency.
arXiv Detail & Related papers (2025-11-26T08:36:33Z) - Exploring Structural Degradation in Dense Representations for Self-supervised Learning [84.52554180480037]
We observe a counterintuitive phenomenon in self-supervised learning (SSL): longer training may impair the performance of dense prediction tasks.<n>We refer to this phenomenon as Self-supervised Dense Degradation (SDD) and demonstrate its consistent presence across sixteen state-of-the-art SSL methods.<n>We introduce a Dense representation Structure Estimator (DSE) composed of a class-relevance measure and an effective dimensionality measure.
arXiv Detail & Related papers (2025-10-20T08:40:16Z) - FedEL: Federated Elastic Learning for Heterogeneous Devices [14.499606660793239]
Federated learning (FL) enables distributed devices to collaboratively train machine learning models while maintaining data privacy.<n>Existing solutions such as client selection, asynchronous FL, and partial training partially address these challenges but encounter issues such as reduced accuracy, stale updates, and compromised model performance due to inconsistent training contributions.<n>We propose FedEL, a federated elastic learning framework that enhances training efficiency while maintaining model accuracy.
arXiv Detail & Related papers (2025-09-21T03:25:46Z) - CAFE-AD: Cross-Scenario Adaptive Feature Enhancement for Trajectory Planning in Autonomous Driving [20.310884346712054]
CAFE-AD is a cross-Scenario Adaptive Feature Enhancement for Trajectory Planning in Autonomous Driving.
We develop an adaptive feature pruning module that ranks feature importance to capture the most relevant information.
A cross-scenario feature learning module alleviates scenario information to introduce diversity, enabling the network to over-fitting in dominant scenarios.
arXiv Detail & Related papers (2025-04-09T05:16:29Z) - USDRL: Unified Skeleton-Based Dense Representation Learning with Multi-Grained Feature Decorrelation [24.90512145836643]
We introduce a Unified Skeleton-based Dense Representation Learning framework based on feature decorrelation.<n>We show that our approach significantly outperforms the current state-of-the-art (SOTA) approaches.
arXiv Detail & Related papers (2024-12-12T12:20:27Z) - A federated large language model for long-term time series forecasting [4.696083734269233]
We propose FedTime, a federated large language model (LLM) tailored for long-range time series prediction.
We employ K-means clustering to partition edge devices or clients into distinct clusters.
We also incorporate channel independence and patching to better preserve local semantic information.
arXiv Detail & Related papers (2024-07-30T02:38:27Z) - SFANet: Spatial-Frequency Attention Network for Weather Forecasting [54.470205739015434]
Weather forecasting plays a critical role in various sectors, driving decision-making and risk management.
Traditional methods often struggle to capture the complex dynamics of meteorological systems.
We propose a novel framework designed to address these challenges and enhance the accuracy of weather prediction.
arXiv Detail & Related papers (2024-05-29T08:00:15Z) - EAS-SNN: End-to-End Adaptive Sampling and Representation for Event-based Detection with Recurrent Spiking Neural Networks [14.046487518350792]
Spiking Neural Networks (SNNs) operate on an event-driven through sparse spike communication.
We introduce Residual Potential Dropout (RPD) and Spike-Aware Training (SAT) to regulate potential distribution.
Our method yields a 4.4% mAP improvement on the Gen1 dataset, while requiring 38% fewer parameters and only three time steps.
arXiv Detail & Related papers (2024-03-19T09:34:11Z) - Embedded feature selection in LSTM networks with multi-objective
evolutionary ensemble learning for time series forecasting [49.1574468325115]
We present a novel feature selection method embedded in Long Short-Term Memory networks.
Our approach optimize the weights and biases of the LSTM in a partitioned manner.
Experimental evaluations on air quality time series data from Italy and southeast Spain demonstrate that our method substantially improves the ability generalization of conventional LSTMs.
arXiv Detail & Related papers (2023-12-29T08:42:10Z) - Cross-modal Prompts: Adapting Large Pre-trained Models for Audio-Visual
Downstream Tasks [55.36987468073152]
This paper proposes a novel Dual-Guided Spatial-Channel-Temporal (DG-SCT) attention mechanism.
The DG-SCT module incorporates trainable cross-modal interaction layers into pre-trained audio-visual encoders.
Our proposed model achieves state-of-the-art results across multiple downstream tasks, including AVE, AVVP, AVS, and AVQA.
arXiv Detail & Related papers (2023-11-09T05:24:20Z) - Test-Time Compensated Representation Learning for Extreme Traffic
Forecasting [13.859278899032846]
congestion and rush hours can result in low correlation in vehicle speeds at various intersections during adjacent time periods.
Existing methods generally predict future series based on recent and entirely decomposed training data during the testing phase.
We propose a test-time representation learning framework comprising a multi-head spatial spatial transformer model.
arXiv Detail & Related papers (2023-09-16T18:46:34Z) - Time-sensitive Learning for Heterogeneous Federated Edge Intelligence [52.83633954857744]
We investigate real-time machine learning in a federated edge intelligence (FEI) system.
FEI systems exhibit heterogenous communication and computational resource distribution.
We propose a time-sensitive federated learning (TS-FL) framework to minimize the overall run-time for collaboratively training a shared ML model.
arXiv Detail & Related papers (2023-01-26T08:13:22Z) - AASeg: Attention Aware Network for Real Time Semantic Segmentation [0.0]
We propose AASeg, a novel Attention-Aware Network for real-time semantic segmentation.<n>We show that AASeg achieves a compelling trade-off between accuracy and efficiency, outperforming prior real-time methods.
arXiv Detail & Related papers (2021-07-27T20:01:55Z) - FASA: Feature Augmentation and Sampling Adaptation for Long-Tailed
Instance Segmentation [91.129039760095]
Recent methods for long-tailed instance segmentation still struggle on rare object classes with few training data.
We propose a simple yet effective method, Feature Augmentation and Sampling Adaptation (FASA)
FASA is a fast, generic method that can be easily plugged into standard or long-tailed segmentation frameworks.
arXiv Detail & Related papers (2021-02-25T14:07:23Z) - FMA-ETA: Estimating Travel Time Entirely Based on FFN With Attention [88.33372574562824]
We propose a novel framework based on feed-forward network (FFN) for ETA, FFN with Multi-factor self-Attention (FMA-ETA)
The novel Multi-factor self-attention mechanism is proposed to deal with different category features and aggregate the information purposefully.
Experiments show FMA-ETA is competitive with state-of-the-art methods in terms of the prediction accuracy with significantly better inference speed.
arXiv Detail & Related papers (2020-06-07T08:10:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.