CISOL: An Open and Extensible Dataset for Table Structure Recognition in the Construction Industry

• URL: http://arxiv.org/abs/2501.15469v1
• Date: Sun, 26 Jan 2025 10:16:21 GMT
• Title: CISOL: An Open and Extensible Dataset for Table Structure Recognition in the Construction Industry
• Abstract summary: This paper introduces the Construction Industry Steel Ordering List (CISOL) dataset.<n>CISOL provides a valuable new research resource and highlights the importance of having diverse datasets.<n>The dataset contains more than 120,000 annotated instances in over 800 document images.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Reproducibility and replicability are critical pillars of empirical research, particularly in machine learning, where they depend not only on the availability of models, but also on the datasets used to train and evaluate those models. In this paper, we introduce the Construction Industry Steel Ordering List (CISOL) dataset, which was developed with a focus on transparency to ensure reproducibility, replicability, and extensibility. CISOL provides a valuable new research resource and highlights the importance of having diverse datasets, even in niche application domains such as table extraction in civil engineering. CISOL is unique in that it contains real-world civil engineering documents from industry, making it a distinctive contribution to the field. The dataset contains more than 120,000 annotated instances in over 800 document images, positioning it as a medium-sized dataset that provides a robust foundation for Table Structure Recognition (TSR) and Table Detection (TD) tasks. Benchmarking results show that CISOL achieves 67.22 mAP@0.5:0.95:0.05 using the YOLOv8 model, outperforming the TSR-specific TATR model. This highlights the effectiveness of CISOL as a benchmark for advancing TSR, especially in specialized domains.

Related papers

• TDATR: Improving End-to-End Table Recognition via Table Detail-Aware Learning and Cell-Level Visual Alignment [70.83664203825235]
  TDATR (Table Detail-Aware Table Recognition) improves end-to-end TR through table detail-aware learning and cell-level visual alignment.<n>We achieve state-of-the-art or highly competitive performance on seven benchmarks without dataset-specific fine-tuning.
  arXiv  Detail & Related papers  (2026-03-24T05:45:02Z)
• TableNet A Large-Scale Table Dataset with LLM-Powered Autonomous [4.207642146162365]
  Table Structure Recognition (TSR) requires the logical reasoning ability of large language models (LLMs) to handle complex table layouts.<n>We present TableNet dataset, a new table structure recognition dataset collected and generated through multiple sources.
  arXiv  Detail & Related papers  (2026-02-27T02:44:38Z)
• Language Model Representations for Efficient Few-Shot Tabular Classification [17.63549220100997]
  Large language models (LLMs) are becoming an increasingly integral component of web infrastructure for tasks like semantic search.<n>This work investigates a lightweight paradigm, $textbfTa$ble $textbfR$epresentation with $textbfL$anguage Model.<n>We show that our approach achieves performance comparable to state-of-the-art models in low-data regimes.
  arXiv  Detail & Related papers  (2026-01-21T23:28:51Z)
• MatSKRAFT: A framework for large-scale materials knowledge extraction from scientific tables [19.837905352477453]
  MatSKRAFT is a framework that automatically extracts and integrates materials science knowledge from tabular data at unprecedented scale.<n>MatSKRAFT significantly outperforms state-of-the-art large language models, achieving F1 scores of 88.68 for property extraction and 71.35 for composition extraction.
  arXiv  Detail & Related papers  (2025-09-12T17:55:11Z)
• Statistical Comparative Analysis of Semantic Similarities and Model Transferability Across Datasets for Short Answer Grading [3.7723788828505125]
  This study investigates the transferability of state-of-the-art (SOTA) models trained on established datasets to an unexplored text dataset.<n>The primary goal of this work is to yield comprehensive insights into the potential applicability and adaptability of SOTA models.
  arXiv  Detail & Related papers  (2025-08-19T05:45:02Z)
• MMTU: A Massive Multi-Task Table Understanding and Reasoning Benchmark [70.47478110973042]
  We introduce MMTU, a large-scale benchmark with over 30K questions across 25 real-world table tasks.<n> MMTU is designed to comprehensively evaluate models ability to understand, reason, and manipulate real tables at the expert-level.<n>We show that MMTU require a combination of skills -- including table understanding, reasoning, and coding -- that remain challenging for today's frontier models.
  arXiv  Detail & Related papers  (2025-06-05T21:05:03Z)
• RAPTOR: Refined Approach for Product Table Object Recognition [0.1516287840715525]
  This research introduces RAPTOR, a modular post-processing system designed to enhance state-of-the-art models for improved table extraction. RAPTOR addresses recurrent Table Detection (TD) and Table Structure Recognition (TSR) issues, improving both precision structural predictions. The results demonstrate that while our approach excels at product tables, it also maintains reasonable performance across diverse table formats.
  arXiv  Detail & Related papers  (2025-02-19T13:59:06Z)
• Large Language Models and Synthetic Data for Monitoring Dataset Mentions in Research Papers [0.0]
  This paper presents a machine learning framework that automates dataset mention detection across research domains. We employ zero-shot extraction from research papers, an LLM-as-a-Judge for quality assessment, and a reasoning agent for refinement to generate a weakly supervised synthetic dataset. At inference, a ModernBERT-based classifier efficiently filters dataset mentions, reducing computational overhead while maintaining high recall.
  arXiv  Detail & Related papers  (2025-02-14T16:16:02Z)
• MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale [66.73529246309033]
  multimodal large language models (MLLMs) have shown significant potential in a broad range of multimodal tasks.<n>Existing instruction-tuning datasets only provide phrase-level answers without any intermediate rationales.<n>We introduce a scalable and cost-effective method to construct a large-scale multimodal instruction-tuning dataset with rich intermediate rationales.
  arXiv  Detail & Related papers  (2024-12-06T18:14:24Z)
• SciER: An Entity and Relation Extraction Dataset for Datasets, Methods, and Tasks in Scientific Documents [49.54155332262579]
  We release a new entity and relation extraction dataset for entities related to datasets, methods, and tasks in scientific articles. Our dataset contains 106 manually annotated full-text scientific publications with over 24k entities and 12k relations.
  arXiv  Detail & Related papers  (2024-10-28T15:56:49Z)
• ArxivDIGESTables: Synthesizing Scientific Literature into Tables using Language Models [58.34560740973768]
  We introduce a framework that leverages language models (LMs) to generate literature review tables. A new dataset of 2,228 literature review tables extracted from ArXiv papers synthesize a total of 7,542 research papers. We evaluate LMs' abilities to reconstruct reference tables, finding this task benefits from additional context.
  arXiv  Detail & Related papers  (2024-10-25T18:31:50Z)
• RelBench: A Benchmark for Deep Learning on Relational Databases [78.52438155603781]
  We present RelBench, a public benchmark for solving tasks over databases with graph neural networks. We use RelBench to conduct the first comprehensive study of Deep Learning infrastructure. RDL learns better whilst reducing human work needed by more than an order of magnitude.
  arXiv  Detail & Related papers  (2024-07-29T14:46:13Z)
• DiscoveryBench: Towards Data-Driven Discovery with Large Language Models [50.36636396660163]
  We present DiscoveryBench, the first comprehensive benchmark that formalizes the multi-step process of data-driven discovery. Our benchmark contains 264 tasks collected across 6 diverse domains, such as sociology and engineering. Our benchmark, thus, illustrates the challenges in autonomous data-driven discovery and serves as a valuable resource for the community to make progress.
  arXiv  Detail & Related papers  (2024-07-01T18:58:22Z)
• Enhancing Knowledge Retrieval with In-Context Learning and Semantic Search through Generative AI [3.9773527114058855]
  We propose a novel methodology that combines the generative capabilities of Large Language Models with the fast and accurate retrieval capabilities of vector databases. The developed model, Generative Text Retrieval (GTR), is adaptable to both unstructured and structured data with minor refinement. The refined model, Generative Tabular Text Retrieval (GTR-T), demonstrated its efficiency in large database querying.
  arXiv  Detail & Related papers  (2024-06-13T23:08:06Z)
• StructLM: Towards Building Generalist Models for Structured Knowledge Grounding [49.10029030628653]
  Large language models' (LLMs) ability to process structured data lags behind state-of-the-art (SoTA) model by an average of 35%. We train a series of models, referred to as StructLM, based on the Mistral and the CodeLlama model family, ranging from 7B to 34B parameters. Our StructLM series surpasses task-specific models on 16 out of 18 evaluated datasets and establishes new SoTA performance on 8 SKG tasks.
  arXiv  Detail & Related papers  (2024-02-26T15:47:01Z)
• Schema-Driven Information Extraction from Heterogeneous Tables [37.50854811537401]
  We present a benchmark comprised of tables from four diverse domains: machine learning papers, chemistry literature, material science journals, and webpages. Our experiments demonstrate that surprisingly competitive performance can be achieved without requiring task-specific pipelines or labels.
  arXiv  Detail & Related papers  (2023-05-23T17:58:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.