MinerU.Chem: A High-Precision System for Optical Chemical Structure and Reaction Recognition
- URL: http://arxiv.org/abs/2608.03525v2
- Date: Wed, 05 Aug 2026 02:35:44 GMT
- Title: MinerU.Chem: A High-Precision System for Optical Chemical Structure and Reaction Recognition
- Abstract summary: MinerU-Chem is a document parsing system for organic chemistry literature integrated into the MinerU online platform.<n>Built on top of MinerU's general document parsing pipeline, MinerU-Chem adds five chemistry-specific modules.<n>For molecular structure recognition, MinerU-Chem uses CARBON as its core representation.
- Score: 91.38955433649268
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: In organic chemistry papers and patents, molecular structures, reaction schemes, and experimental conditions are often presented as molecular structure depictions, reaction diagrams, and complex tables or figures. Such information is difficult for general-purpose document parsing systems to directly convert into machine-readable data. This limits data production for organic chemistry knowledge base construction and for AI for Chemistry tasks such as reaction prediction, retrosynthesis, condition recommendation, molecular property prediction, and drug molecule design. This report introduces MinerU-Chem, a document parsing system for organic chemistry literature integrated into the MinerU online platform. Built on top of MinerU's general document parsing pipeline, MinerU-Chem adds five chemistry-specific modules: chemistry relevance filtering, molecular structure detection, molecule identifier extraction, molecular structure recognition, and reaction scheme parsing. Together, these modules convert organic-chemistry-related image regions in documents into a Molecule Summary List and a Reaction Summary List. For molecular structure recognition, MinerU-Chem uses CARBON (Complex Atomic Representation and Bonding Object Notation) as its core representation. CARBON enables recognition results to preserve both the visual layout of the original image and complex chemical semantics, while supporting the export of standard downstream formats such as MolFile and SMILES. On the SMILES-evaluable subset of MolRecBench-Wild (N=2,392), MinerU-Chem's molecular structure recognition module achieves a SMILES exact-match accuracy of 93.02%, outperforming the best evaluated comparison system, GPT-5.6-Sol (74.87%), by 18.15 percentage points. The system has been integrated into the MinerU online platform and is available at https://mineru.net/OpenSourceTools/Extractor .
Related papers
- MolLingo: Molecule-Native Representations for LLM-Powered Scientific Agents [57.28652712579434]
We present MolLingo, a multi-agent system that emulates the reasoning process of a chemist to automate molecular design.<n>MolLingo addresses this by coordinating a Literature Agent, a Chemist Agent, and an Orchestrator through a shared memory module, with each agent equipped with domain-specific tools.<n>As a case study in early-stage therapeutic design, MolLingo grounds the Chemist Agent's reasoning in binding site geometry and residue-level protein context.
arXiv Detail & Related papers (2026-05-27T02:11:23Z) - MolSight: Optical Chemical Structure Recognition with SMILES Pretraining, Multi-Granularity Learning and Reinforcement Learning [47.029225594084345]
MolSight is a comprehensive learning framework that employs a three-stage training paradigm.<n>We show that MolSight achieves state-of-the-art performance in (stereo)chemical optical structure recognition.
arXiv Detail & Related papers (2025-11-21T15:11:47Z) - A Multi-Agent System Enables Versatile Information Extraction from the Chemical Literature [8.306442315850878]
We develop a multimodal large language model (MLLM)-based multi-agent system for robust and automated chemical information extraction.<n>Our system achieved an F1 score of 80.8% on a benchmark dataset of sophisticated multimodal chemical reaction graphics from the literature.
arXiv Detail & Related papers (2025-07-27T11:16:57Z) - ChemActor: Enhancing Automated Extraction of Chemical Synthesis Actions with LLM-Generated Data [53.78763789036172]
We present ChemActor, a fully fine-tuned large language model (LLM) as a chemical executor to convert between unstructured experimental procedures and structured action sequences.<n>This framework integrates a data selection module that selects data based on distribution divergence, with a general-purpose LLM, to generate machine-executable actions from a single molecule input.<n>Experiments on reaction-to-description (R2D) and description-to-action (D2A) tasks demonstrate that ChemActor achieves state-of-the-art performance, outperforming the baseline model by 10%.
arXiv Detail & Related papers (2025-06-30T05:11:19Z) - MolMole: Molecule Mining from Scientific Literature [10.183226397580876]
MolMole is a vision-based deep learning framework that unifies molecule detection, reaction diagram parsing, and optical chemical structure recognition.<n>We present a testset of 550 pages annotated with molecule bounding boxes, reaction labels, and MOLfiles.<n>Results demonstrate that MolMole outperforms existing toolkits on both our benchmark and public datasets.
arXiv Detail & Related papers (2025-04-30T09:30:04Z) - MolParser: End-to-end Visual Recognition of Molecule Structures in the Wild [17.846545370594452]
We present Mol, a novel end-to-end optical chemical structure recognition method.<n>We use a SMILES encoding rule to annotate Mol-7M, the largest annotated molecular image dataset.<n>We trained an end-to-end molecular image captioning model, Mol, using a curriculum learning approach.
arXiv Detail & Related papers (2024-11-17T15:00:09Z) - SMiCRM: A Benchmark Dataset of Mechanistic Molecular Images [0.8192907805418583]
We present a dataset designed to benchmark machine recognition capabilities of chemical molecules with arrow-pushing annotations.
This dataset includes a machine-readable molecular identity for each image as well as mechanistic arrows showing electron flow during chemical reactions.
arXiv Detail & Related papers (2024-07-25T18:52:10Z) - ChemMiner: A Large Language Model Agent System for Chemical Literature Data Mining [56.15126714863963]
ChemMiner is an end-to-end framework for extracting chemical data from literature.<n>ChemMiner incorporates three specialized agents: a text analysis agent for coreference mapping, a multimodal agent for non-textual information extraction, and a synthesis analysis agent for data generation.<n> Experimental results demonstrate reaction identification rates comparable to human chemists while significantly reducing processing time, with high accuracy, recall, and F1 scores.
arXiv Detail & Related papers (2024-02-20T13:21:46Z) - ChemLLM: A Chemical Large Language Model [49.308528569982805]
Large language models (LLMs) have made impressive progress in chemistry applications.
However, the community lacks an LLM specifically designed for chemistry.
Here, we introduce ChemLLM, a comprehensive framework that features the first LLM dedicated to chemistry.
arXiv Detail & Related papers (2024-02-10T01:11:59Z) - MolGrapher: Graph-based Visual Recognition of Chemical Structures [50.13749978547401]
We introduce MolGrapher to recognize chemical structures visually.
We treat all candidate atoms and bonds as nodes and put them in a graph.
We classify atom and bond nodes in the graph with a Graph Neural Network.
arXiv Detail & Related papers (2023-08-23T16:16:11Z) - IMG2SMI: Translating Molecular Structure Images to Simplified
Molecular-input Line-entry System [29.946393284884778]
We introduce IMG2SMI, a model which leverages Deep Residual Networks for image feature extraction and an encoder-decoder Transformer layers for molecule description generation.
IMG2SMI outperforms OSRA-based systems by 163% in molecule similarity prediction as measured by the molecular MACCS Fingerprint Tanimoto Similarity.
We also release a new molecule prediction dataset including 81 million molecules for molecule description generation.
arXiv Detail & Related papers (2021-09-03T19:57:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.