AnaMeta: A Table Understanding Dataset of Field Metadata Knowledge Shared by Multi-dimensional Data Analysis Tasks

• URL: http://arxiv.org/abs/2209.00946v2
• Date: Sat, 27 May 2023 11:27:42 GMT
• Title: AnaMeta: A Table Understanding Dataset of Field Metadata Knowledge Shared by Multi-dimensional Data Analysis Tasks
• Abstract summary: We introduce the AnaMeta dataset, a collection of 467k tables with derived supervision labels for four types of commonly used field metadata. We evaluate a wide range of models for inferring metadata as the benchmark. We propose four interfaces for incorporating field metadata into downstream analysis tasks.
• Score: 30.63485722768747
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Tabular data analysis is performed every day across various domains. It requires an accurate understanding of field semantics to correctly operate on table fields and find common patterns in daily analysis. In this paper, we introduce the AnaMeta dataset, a collection of 467k tables with derived supervision labels for four types of commonly used field metadata: measure/dimension dichotomy, common field roles, semantic field type, and default aggregation function. We evaluate a wide range of models for inferring metadata as the benchmark. We also propose a multi-encoder framework, called KDF, which improves the metadata understanding capability of tabular models by incorporating distribution and knowledge information. Furthermore, we propose four interfaces for incorporating field metadata into downstream analysis tasks.

Related papers

• World-POI: Global Point-of-Interest Data Enriched from Foursquare and OpenStreetMap as Tabular and Graph Data [1.2107297090229685]
  Recently, Foursquare released a global dataset with more than 100 million points of interest (POIs)<n>In contrast, OpenStreetMap (OSM) offers a rich, user-contributed POI dataset with detailed and frequently updated metadata.<n>We present a methodology that integrates the strengths of both datasets.
  arXiv  Detail & Related papers  (2025-10-24T11:12:41Z)
• From Surface to Semantics: Semantic Structure Parsing for Table-Centric Document Analysis [9.526986293067576]
  DOTABLER is a table-centric semantic document parsing framework.<n>It delivers comprehensive table-anchored semantic analysis and precise extraction of semantically relevant tables.<n> evaluated on nearly 4,000 pages with over 1,000 tables from real-world PDFs.
  arXiv  Detail & Related papers  (2025-08-14T03:29:51Z)
• Towards Automated Cross-domain Exploratory Data Analysis through Large Language Models [14.236566119377352]
  This paper presents TiInsight, an automated cross-domain exploratory data analysis system. TiInsight achieves hierarchical execution accuracy of 86.3% on the Spider dataset using GPT-4. It also demonstrates state-of-the-art performance on the Bird dataset.
  arXiv  Detail & Related papers  (2024-12-10T06:11:23Z)
• BabelBench: An Omni Benchmark for Code-Driven Analysis of Multimodal and Multistructured Data [61.936320820180875]
  Large language models (LLMs) have become increasingly pivotal across various domains. BabelBench is an innovative benchmark framework that evaluates the proficiency of LLMs in managing multimodal multistructured data with code execution. Our experimental findings on BabelBench indicate that even cutting-edge models like ChatGPT 4 exhibit substantial room for improvement.
  arXiv  Detail & Related papers  (2024-10-01T15:11:24Z)
• Exploiting Formal Concept Analysis for Data Modeling in Data Lakes [0.29998889086656577]
  This paper introduces a practical data visualization and analysis approach rooted in Formal Concept Analysis (FCA) We represent data structures as objects, analyze the concept lattice, and present two strategies-top-down and bottom-up-to unify these structures and establish a common schema. We achieve a complete coverage of 80 percent of data structures with only 34 distinct field names.
  arXiv  Detail & Related papers  (2024-08-11T13:58:31Z)
• TOTEM: TOkenized Time Series EMbeddings for General Time Series Analysis [32.854449155765344]
  We propose a simple tokenizer architecture that embeds time series data from varying domains using a discrete vectorized representation learned in a self-supervised manner. We study the efficacy of TOTEM with an extensive evaluation on 17 real world time series datasets across 3 tasks.
  arXiv  Detail & Related papers  (2024-02-26T09:11:12Z)
• Text2Analysis: A Benchmark of Table Question Answering with Advanced Data Analysis and Unclear Queries [67.0083902913112]
  We develop the Text2Analysis benchmark, incorporating advanced analysis tasks. We also develop five innovative and effective annotation methods. We evaluate five state-of-the-art models using three different metrics.
  arXiv  Detail & Related papers  (2023-12-21T08:50:41Z)
• infoVerse: A Universal Framework for Dataset Characterization with Multidimensional Meta-information [68.76707843019886]
  infoVerse is a universal framework for dataset characterization. infoVerse captures multidimensional characteristics of datasets by incorporating various model-driven meta-information. In three real-world applications (data pruning, active learning, and data annotation), the samples chosen on infoVerse space consistently outperform strong baselines.
  arXiv  Detail & Related papers  (2023-05-30T18:12:48Z)
• Automatic universal taxonomies for multi-domain semantic segmentation [1.4364491422470593]
  Training semantic segmentation models on multiple datasets has sparked a lot of recent interest in the computer vision community. established datasets have mutually incompatible labels which disrupt principled inference in the wild. We address this issue by automatic construction of universal through iterative dataset integration.
  arXiv  Detail & Related papers  (2022-07-18T08:53:17Z)
• Benchmarking Multimodal AutoML for Tabular Data with Text Fields [83.43249184357053]
  We assemble 18 multimodal data tables that each contain some text fields. Our benchmark enables researchers to evaluate their own methods for supervised learning with numeric, categorical, and text features.
  arXiv  Detail & Related papers  (2021-11-04T09:29:16Z)
• Explaining the Performance of Multi-label Classification Methods with Data Set Properties [1.1278903078792917]
  We present a comprehensive meta-learning study of data sets and methods for multi-label classification (MLC) Here, we analyze 40 MLC data sets by using 50 meta features describing different properties of the data. The most prominent meta features that describe the space of MLC data sets are the ones assessing different aspects of the label space.
  arXiv  Detail & Related papers  (2021-06-28T11:00:05Z)
• Simple multi-dataset detection [83.9604523643406]
  We present a simple method for training a unified detector on multiple large-scale datasets. We show how to automatically integrate dataset-specific outputs into a common semantic taxonomy. Our approach does not require manual taxonomy reconciliation.
  arXiv  Detail & Related papers  (2021-02-25T18:55:58Z)
• Mapping Patterns for Virtual Knowledge Graphs [71.61234136161742]
  Virtual Knowledge Graphs (VKG) constitute one of the most promising paradigms for integrating and accessing legacy data sources. We build on well-established methodologies and patterns studied in data management, data analysis, and conceptual modeling. We validate our catalog on the considered VKG scenarios, showing it covers the vast majority of patterns present therein.
  arXiv  Detail & Related papers  (2020-12-03T13:54:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.