OpenHoldem: An Open Toolkit for Large-Scale Imperfect-Information Game Research

• URL: http://arxiv.org/abs/2012.06168v2
• Date: Sat, 19 Dec 2020 14:23:46 GMT
• Title: OpenHoldem: An Open Toolkit for Large-Scale Imperfect-Information Game Research
• Authors: Kai Li, Hang Xu, Meng Zhang, Enmin Zhao, Zhe Wu, Junliang Xing, Kaiqi Huang
• Abstract summary: OpenHoldem is an integrated toolkit for large-scale imperfect-information game research using NLTH. OpenHoldem makes three main contributions to this research direction: 1) a standardized evaluation protocol for thoroughly evaluating different NLTH AIs, 2) three publicly available strong baselines for NLTH AI, and 3) an online testing platform with easy-to-use APIs for public NLTH AI evaluation.
• Score: 82.09426894653237
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Owning to the unremitting efforts by a few institutes, significant progress has recently been made in designing superhuman AIs in No-limit Texas Hold'em (NLTH), the primary testbed for large-scale imperfect-information game research. However, it remains challenging for new researchers to study this problem since there are no standard benchmarks for comparing with existing methods, which seriously hinders further developments in this research area. In this work, we present OpenHoldem, an integrated toolkit for large-scale imperfect-information game research using NLTH. OpenHoldem makes three main contributions to this research direction: 1) a standardized evaluation protocol for thoroughly evaluating different NLTH AIs, 2) three publicly available strong baselines for NLTH AI, and 3) an online testing platform with easy-to-use APIs for public NLTH AI evaluation. We have released OpenHoldem at http://holdem.ia.ac.cn/, hoping it facilitates further studies on the unsolved theoretical and computational issues in this area and cultivate crucial research problems like opponent modeling, large-scale equilibrium-finding, and human-computer interactive learning.

Related papers

• CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings [70.95565672516979]
  Existing benchmarks, like LiveCodeBench and USACO, fall short due to the unavailability of private test cases, lack of support for special judges, and misaligned execution environments. CodeElo is a standardized competition-level code generation benchmark that effectively addresses all these challenges for the first time.
  arXiv  Detail & Related papers  (2025-01-02T13:49:00Z)
• Artificial Intelligence of Things: A Survey [14.204632921719933]
  The integration of the Internet of Things (IoT) and modern Artificial Intelligence (AI) has given rise to a new paradigm known as the Artificial Intelligence of Things (AIoT) We examine AIoT literature related to sensing, computing, and networking & communication, which form the three key components of AIoT. In addition to advancements in these areas, we review domain-specific AIoT systems that are designed for various important application domains.
  arXiv  Detail & Related papers  (2024-10-25T22:45:58Z)
• A Comprehensive Survey on Underwater Image Enhancement Based on Deep Learning [51.7818820745221]
  Underwater image enhancement (UIE) presents a significant challenge within computer vision research. Despite the development of numerous UIE algorithms, a thorough and systematic review is still absent.
  arXiv  Detail & Related papers  (2024-05-30T04:46:40Z)
• Quantitative Analysis of AI-Generated Texts in Academic Research: A Study of AI Presence in Arxiv Submissions using AI Detection Tool [0.0]
  This study will analyze a method that can see purposely manufactured content that academic organizations use to post on Arxiv. The statistical analysis shows that Originality.ai is very accurate, with a rate of 98%.
  arXiv  Detail & Related papers  (2024-02-09T17:20:48Z)
• How do machines learn? Evaluating the AIcon2abs method [0.0]
  This study is an expansion of a previous work aiming to evaluate the AIcon2abs method (AI from Concrete to Abstract: Demystifying Artificial Intelligence to the general public) The approach employs the WiSARD algorithm, a weightless neural network known for its simplicity, and user accessibility. WiSARD does not require Internet, making it ideal for non-technical users and resource-limited environments.
  arXiv  Detail & Related papers  (2024-01-14T22:40:58Z)
• Unveiling the Limits of Learned Local Search Heuristics: Are You the Mightiest of the Meek? [14.195843311387591]
  We show that a simple learned based on Tabu Search surpasses state-of-the-art learneds in terms of performance and generalizability. Our findings challenge prevailing assumptions and open up exciting avenues for future research.
  arXiv  Detail & Related papers  (2023-10-30T20:16:42Z)
• A Semi-Automated Solution Approach Recommender for a Given Use Case: a Case Study for AI/ML in Oncology via Scopus and OpenAI [0.6749750044497732]
  Our proposed tool, SARBOLD-LLM, allows discovering and choosing among methods related to a given problem. It provides additional information about their uses in the literature to derive decision-making insights. It is a useful tool to select which methods to investigate first and comes as a complement to surveys.
  arXiv  Detail & Related papers  (2023-07-10T14:07:28Z)
• OpenAGI: When LLM Meets Domain Experts [51.86179657467822]
  Human Intelligence (HI) excels at combining basic skills to solve complex tasks. This capability is vital for Artificial Intelligence (AI) and should be embedded in comprehensive AI Agents. We introduce OpenAGI, an open-source platform designed for solving multi-step, real-world tasks.
  arXiv  Detail & Related papers  (2023-04-10T03:55:35Z)
• LID 2020: The Learning from Imperfect Data Challenge Results [242.86700551532272]
  Learning from Imperfect Data workshop aims to inspire and facilitate the research in developing novel approaches. We organize three challenges to find the state-of-the-art approaches in weakly supervised learning setting. This technical report summarizes the highlights from the challenge.
  arXiv  Detail & Related papers  (2020-10-17T13:06:12Z)
• Covidex: Neural Ranking Models and Keyword Search Infrastructure for the COVID-19 Open Research Dataset [87.47567807116204]
  Covidex is a search engine that exploits the latest neural ranking models. It provides access to the COVID-19 Open Research dataset curated by the Allen Institute for AI.
  arXiv  Detail & Related papers  (2020-07-14T16:26:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.