Commentary Generation from Data Records of Multiplayer Strategy Esports Game

• URL: http://arxiv.org/abs/2212.10935v3
• Date: Tue, 08 Oct 2024 12:05:14 GMT
• Title: Commentary Generation from Data Records of Multiplayer Strategy Esports Game
• Authors: Zihan Wang, Naoki Yoshinaga,
• Abstract summary: We build large-scale datasets that pair structured data and commentaries from a popular esports game, League of Legends. We then evaluate Transformer-based models to generate game commentaries from structured data records. We will release our dataset to boost potential research in the data-to-text generation community.
• Score: 21.133690853111133
• License:
• Abstract: Esports, a sports competition on video games, has become one of the most important sporting events. Although esports play logs have been accumulated, only a small portion of them accompany text commentaries for the audience to retrieve and understand the plays. In this study, we therefore introduce the task of generating game commentaries from esports' data records. We first build large-scale esports data-to-text datasets that pair structured data and commentaries from a popular esports game, League of Legends. We then evaluate Transformer-based models to generate game commentaries from structured data records, while examining the impact of the pre-trained language models. Evaluation results on our dataset revealed the challenges of this novel task. We will release our dataset to boost potential research in the data-to-text generation community.

Related papers

• Deep learning for action spotting in association football videos [64.10841325879996]
  The SoccerNet initiative organizes yearly challenges, during which participants from all around the world compete to achieve state-of-the-art performances. This paper traces the history of action spotting in sports, from the creation of the task back in 2018, to the role it plays today in research and the sports industry.
  arXiv  Detail & Related papers  (2024-10-02T07:56:15Z)
• MatchTime: Towards Automatic Soccer Game Commentary Generation [52.431010585268865]
  We consider constructing an automatic soccer game commentary model to improve the audiences' viewing experience. First, observing the prevalent video-text misalignment in existing datasets, we manually annotate timestamps for 49 matches. Second, we propose a multi-modal temporal alignment pipeline to automatically correct and filter the existing dataset at scale. Third, based on our curated dataset, we train an automatic commentary generation model, named MatchVoice.
  arXiv  Detail & Related papers  (2024-06-26T17:57:25Z)
• SoccerNet-Echoes: A Soccer Game Audio Commentary Dataset [46.60191376520379]
  This paper presents SoccerNet-Echoes, an augmentation of the SoccerNet dataset with automatically generated transcriptions of audio commentaries from soccer game broadcasts. By incorporating textual data alongside visual and auditory content, SoccerNet-Echoes aims to serve as a comprehensive resource for the development of algorithms specialized in capturing the dynamics of soccer games.
  arXiv  Detail & Related papers  (2024-05-12T18:25:38Z)
• Game-MUG: Multimodal Oriented Game Situation Understanding and Commentary Generation Dataset [8.837048597513059]
  This paper introduces GAME-MUG, a new multimodal game situation understanding and audience-engaged commentary generation dataset. Our dataset is collected from 2020-2022 LOL game live streams from YouTube and Twitch, and includes multimodal esports game information, including text, audio, and time-series event logs. In addition, we also propose a new audience conversation augmented commentary dataset by covering the game situation and audience conversation understanding.
  arXiv  Detail & Related papers  (2024-04-30T00:39:26Z)
• Going for GOAL: A Resource for Grounded Football Commentaries [66.10040637644697]
  We present GrOunded footbAlL commentaries (GOAL), a novel dataset of football (or soccer') highlights videos with transcribed live commentaries in English. We provide state-of-the-art baselines for the following tasks: frame reordering, moment retrieval, live commentary retrieval and play-by-play live commentary generation. Results show that SOTA models perform reasonably well in most tasks.
  arXiv  Detail & Related papers  (2022-11-08T20:04:27Z)
• ESTA: An Esports Trajectory and Action Dataset [0.0]
  We use esports data to develop machine learning models for win prediction. Awpy is an open-source library that can extract player trajectories and actions from game logs. ESTA is one of the largest and most granular publicly available sports data sets to date.
  arXiv  Detail & Related papers  (2022-09-20T17:13:50Z)
• GOAL: Towards Benchmarking Few-Shot Sports Game Summarization [0.3683202928838613]
  We release GOAL, the first English sports game summarization dataset. There are 103 commentary-news pairs in GOAL, where the average lengths of commentaries and news are 2724.9 and 476.3 words, respectively.
  arXiv  Detail & Related papers  (2022-07-18T14:29:18Z)
• SC2EGSet: StarCraft II Esport Replay and Game-state Dataset [0.0]
  This work aims to open esports to a broader scientific community by supplying raw and pre-processed files from StarCraft II esports tournaments. We have publicly available game-engine generated "replays" of tournament matches and performed data extraction using a low-level application programming interface (API) library. Our dataset contains replays from major and premiere StarCraft II tournaments since 2016.
  arXiv  Detail & Related papers  (2022-07-07T16:52:53Z)
• A Survey on Video Action Recognition in Sports: Datasets, Methods and Applications [60.3327085463545]
  We present a survey on video action recognition for sports analytics. We introduce more than ten types of sports, including team sports, such as football, basketball, volleyball, hockey and individual sports, such as figure skating, gymnastics, table tennis, diving and badminton. We develop a toolbox using PaddlePaddle, which supports football, basketball, table tennis and figure skating action recognition.
  arXiv  Detail & Related papers  (2022-06-02T13:19:36Z)
• Knowledge Enhanced Sports Game Summarization [14.389241106925438]
  We introduce K-SportsSum, a new dataset with two characteristics. K-SportsSum collects a large amount of data from massive games. K-SportsSum further provides a large-scale knowledge corpus that contains the information of 523 sports teams and 14,724 sports players.
  arXiv  Detail & Related papers  (2021-11-24T15:06:20Z)
• SoccerNet-v2: A Dataset and Benchmarks for Holistic Understanding of Broadcast Soccer Videos [71.72665910128975]
  SoccerNet-v2 is a novel large-scale corpus of manual annotations for the SoccerNet video dataset. We release around 300k annotations within SoccerNet's 500 untrimmed broadcast soccer videos. We extend current tasks in the realm of soccer to include action spotting, camera shot segmentation with boundary detection.
  arXiv  Detail & Related papers  (2020-11-26T16:10:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.