TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streaming

• URL: http://arxiv.org/abs/2607.02090v1
• Date: Thu, 02 Jul 2026 12:29:45 GMT
• Title: TCG-AR: Real-Time Multi-View Augmented Reality for Trading Card Game Streaming
• Abstract summary: TCG-AR is a novel real-time pipeline that augments trading card games using ordinary RGB cameras alone.<n>Our pipeline detects, orients, and identifies the cards on the board.<n>It can additionally compose a broadcaststyle view that summarizes the game state for spectators.
• Score: 18.287539397902417
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Trading card games are increasingly played and broadcast online, yet live streams remain mostly limited to flat top-down footage of the playing area. Augmenting such streams with virtual models of the played cards would improve the viewing experience, but most existing systems rely on instrumented playing surfaces and embedded chips, which are costly and impractical for casual players and large-scale events. In this work, we present TCG-AR, a novel real-time pipeline that augments trading card games using ordinary RGB cameras alone, without any physical markers or specialized hardware. Our pipeline detects, orients, and identifies the cards on the board, renders virtual content onto each card across all views, and can additionally compose a broadcaststyle view that summarizes the game state for spectators, streaming the augmented feeds to standard broadcasting software such as OBS. To train the detection, orientation, and identification models without manual labeling, we introduce an automatic procedure that generates annotated synthetic training data from a reference set of card images. Then, we evaluate several trained models on a new manually annotated dataset with real images, analyzing performance and runtime throughput that determine real-world usability. Overall, by relying only on commodity cameras and hardware, and by open-sourcing all code, models, and datasets, this work aims to serve as a reference for real-time trading card recognition and to make real-time augmented-reality streaming accessible to the broader community of players and streamers.

Related papers

• Card-Based Computation in the Virtual Player Simulation Model [0.0]
  We study generic card-based computation in the virtual player simulation model.<n>We present the Play-Minimum protocol, which securely selects and plays the minimum-value card from a virtual player's hand.<n>We also present the Sorting protocol, which securely arranges a virtual player's hand in nondecreasing order.
  arXiv  Detail & Related papers  (2026-09-02T15:24:28Z)
• BasketEvent: Understanding Who Did What and When in Basketball Videos [51.926771112716686]
  We introduce BasketEvent, a player- centric basketball event understanding dataset curated from real NBA broadcasts.<n>We propose PlayNet, a player-centric reasoning framework that maps basketball videos to player-level event predictions.<n>Our data, code, and models will be made publicly available.
  arXiv  Detail & Related papers  (2026-07-23T12:39:56Z)
• Geo-Align: Video Generation Alignment via Metric Geometry Reward [53.65904111864641]
  Geo-Align is the first Reinforcement Learning framework specifically designed for camera-controlled video re-rendering.<n>Built upon a pretrained model, we optimize the model through a scale-aware perceptual reward mechanism.<n>Experiments demonstrate that Geo-Align consistently outperforms existing supervised learning baselines in both precise camera controllability and visual fidelity.
  arXiv  Detail & Related papers  (2026-05-22T17:59:43Z)
• OmniStream: Mastering Perception, Reconstruction and Action in Continuous Streams [57.22276728212066]
  Modern visual agents require representations that are general, causal, and physically structured to operate in real-time streaming environments.<n>This paper introduces OmniStream, a unified streaming visual backbone that effectively perceives, reconstructs, and acts from diverse visual inputs.
  arXiv  Detail & Related papers  (2026-03-12T17:59:55Z)
• REFA: Real-time Egocentric Facial Animations for Virtual Reality [56.82169742343143]
  We present a novel system for real-time tracking of facial expressions using egocentric views captured from a set of infrared cameras embedded in a virtual reality (VR) headset.<n>Our technology facilitates any user to accurately drive the facial expressions of virtual characters in a non-intrusive manner.
  arXiv  Detail & Related papers  (2026-01-07T01:41:46Z)
• From Virtual Games to Real-World Play [34.022575851703145]
  We introduce RealPlay, a neural network-based real-world game engine that enables interactive video generation from user control signals.<n>RealPlay aims to produce photorealistic, temporally consistent video sequences that resemble real-world footage.
  arXiv  Detail & Related papers  (2025-06-23T17:59:53Z)
• Gameplay Highlights Generation [3.019500891118183]
  This work enables gamers to share their gaming experience on social media by automatically generating eye-catching highlight reels from their gameplay session.<n>We develop an in-house gameplay event detection dataset containing interesting events annotated by humans using VIA video annotator.<n>We finetuned a multimodal general purpose video understanding model such as X-CLIP using our dataset which generalizes across multiple games in a genre without per game engineering.
  arXiv  Detail & Related papers  (2025-05-12T16:28:22Z)
• A Simple and Effective Temporal Grounding Pipeline for Basketball Broadcast Footage [0.0]
  We present a reliable temporal grounding pipeline for video-to-analytic alignment of basketball broadcast footage. Our method aligns a pre-labeled corpus of play-by-play annotations containing dense event annotations to video frames, enabling quick retrieval of labeled video segments.
  arXiv  Detail & Related papers  (2024-10-30T17:27:44Z)
• PLayerTV: Advanced Player Tracking and Identification for Automatic Soccer Highlight Clips [2.3920366469105088]
  PlayerTV is an innovative framework which harnesses state-of-the-art AI technologies for automatic player tracking and identification in soccer videos. By integrating object detection and tracking, Optical Character Recognition (OCR), and color analysis, PlayerTV facilitates the generation of player-specific highlight clips. Preliminary results from the evaluation of our core pipeline, tested on a dataset from the Norwegian Eliteserien league, indicate that PlayerTV can accurately and efficiently identify teams and players.
  arXiv  Detail & Related papers  (2024-07-22T22:27:57Z)
• BVI-RLV: A Fully Registered Dataset and Benchmarks for Low-Light Video Enhancement [56.97766265018334]
  This paper introduces a low-light video dataset, consisting of 40 scenes with various motion scenarios under two distinct low-lighting conditions. We provide fully registered ground truth data captured in normal light using a programmable motorized dolly and refine it via an image-based approach for pixel-wise frame alignment across different light levels. Our experimental results demonstrate the significance of fully registered video pairs for low-light video enhancement (LLVE) and the comprehensive evaluation shows that the models trained with our dataset outperform those trained with the existing datasets.
  arXiv  Detail & Related papers  (2024-07-03T22:41:49Z)
• VideoRF: Rendering Dynamic Radiance Fields as 2D Feature Video Streams [56.00479598817949]
  VideoRF is the first approach to enable real-time streaming and rendering of dynamic radiance fields on mobile platforms. We show that the feature image stream can be efficiently compressed by 2D video codecs. We have developed a real-time interactive player that enables online streaming and rendering of dynamic scenes.
  arXiv  Detail & Related papers  (2023-12-03T14:14:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.