JFAA: Technical Report for the EPIC-KITCHENS-100 Action Anticipation Challenge at EgoVis 2026

• URL: http://arxiv.org/abs/2605.20904v1
• Date: Wed, 20 May 2026 08:47:50 GMT
• Title: JFAA: Technical Report for the EPIC-KITCHENS-100 Action Anticipation Challenge at EgoVis 2026
• Abstract summary: JFAA is a JEPA-based Future Action Anticipation method for the EPIC-KITCHENS-100 (EK-100) Action Anticipation task.<n>Inspired by the representation learning and future prediction ability of V-JEPA 2.1, JFAA uses a frozen encoder and predictor to extract observed context features.<n>A lightweight attentive probe is then trained to predict verb, noun, and action logits with separate task queries.
• Score: 70.67609435035631
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose JFAA, a JEPA-based Future Action Anticipation method for the EPIC-KITCHENS-100 (EK-100) Action Anticipation task. Inspired by the representation learning and future prediction ability of V-JEPA 2.1, JFAA uses a frozen encoder and predictor to extract observed context features and near-future latent tokens. A lightweight attentive probe is then trained to predict verb, noun, and action logits with separate task queries. To improve robustness, we further build a field-aware ensemble over selected epoch-level predictions, allowing each output field to benefit from its most reliable candidates. Experimental results on the official challenge server show that JFAA achieves first place in the EgoVis 2026 EK-100 Action Anticipation Challenge. Our code will be released at https://github.com/CorrineQiu/JFAA.

Related papers

• TAP-JEPA: Frozen Future-Latent Probing and Two-Stage Score Fusion for EPIC-KITCHENS-100 Action Anticipation [4.781417767575192]
  This report presents TAP-JEPA, our runner-up submission to the EPIC-KITCHENS-100 (EK-100) Action Anticipation Challenge at EgoVis 2026.<n>The task is to anticipate the next verb, noun, and verb-noun action from an egocentric clip that ends before the target action begins.<n>Instead of fine-tuning a large video backbone, TAP-JEPA builds a compact anticipation model on frozen V-JEPA 2.1 features.
  arXiv  Detail & Related papers  (2026-05-30T10:23:12Z)
• VISTA: Technical Report for the Ego4D Short-Term Object Interaction Anticipation at EgoVis 2026 [70.67609435035631]
  Given an egocentric video timestamp, the task requires anticipating the next human-object interaction.<n>ViSTA follows a StillFast-style design that combines object-centric spatial detection with short-horizon temporal context.<n>Experiments show that VISTA achieves first place in the EgoVis 2026 Ego4D STA Challenge.
  arXiv  Detail & Related papers  (2026-05-20T08:42:56Z)
• Openpi Comet: Competition Solution For 2025 BEHAVIOR Challenge [54.28288180330569]
  The 2025 BEHAVIOR Challenge is designed to rigorously track progress toward solving long-horizon tasks by physical agents in simulated environments.<n>This report presents our solution to the 2025 BEHAVIOR Challenge in a very close 2nd place and substantially outperforms the rest of the submissions.
  arXiv  Detail & Related papers  (2025-12-10T20:46:40Z)
• Technical Report for Ego4D Long-Term Action Anticipation Challenge 2025 [77.414837862995]
  We present a novel three-stage framework developed for the Ego4D Long-Term Action Anticipation task.<n>Inspired by recent advances in foundation models, our method consists of three stages: feature extraction, action recognition, and long-term action anticipation.<n>Our framework achieves first place in this challenge at CVPR 2025, establishing a new state-of-the-art in long-term action prediction.
  arXiv  Detail & Related papers  (2025-06-03T07:36:52Z)
• NVIDIA-UNIBZ Submission for EPIC-KITCHENS-100 Action Anticipation Challenge 2022 [13.603712913129506]
  We describe the technical details of our submission for the EPIC-Kitchen-100 action anticipation challenge. Our modelings, the higher-order recurrent space-time transformer and the message-passing neural network with edge learning, are both recurrent-based architectures which observe only 2.5 seconds inference context to form the action anticipation prediction. By averaging the prediction scores from a set of models compiled with our proposed training pipeline, we achieved strong performance on the test set, which is 19.61% overall mean top-5 recall, recorded as second place on the public leaderboard.
  arXiv  Detail & Related papers  (2022-06-22T06:34:58Z)
• SAIC_Cambridge-HuPBA-FBK Submission to the EPIC-Kitchens-100 Action Recognition Challenge 2021 [80.05652375838073]
  This report presents the technical details of our submission to the EPIC-Kitchens-100 Action Recognition Challenge 2021. Our submission, visible on the public leaderboard, achieved a top-1 action recognition accuracy of 44.82%, using only RGB.
  arXiv  Detail & Related papers  (2021-10-06T16:29:47Z)
• Learning to Anticipate Egocentric Actions by Imagination [60.21323541219304]
  We study the egocentric action anticipation task, which predicts future action seconds before it is performed for egocentric videos. Our method significantly outperforms previous methods on both the seen test set and the unseen test set of the EPIC Kitchens Action Anticipation Challenge.
  arXiv  Detail & Related papers  (2021-01-13T08:04:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.