VERDICT: Agreement Beats Pixel-Space Verification in Real-Document OCSR

• URL: http://arxiv.org/abs/2608.22183v1
• Date: Sun, 23 Aug 2026 02:41:06 GMT
• Title: VERDICT: Agreement Beats Pixel-Space Verification in Real-Document OCSR
• Abstract summary: VERDICT is an image-based interface for searching and retrieving molecular records.<n>It enables validated labels for multimodal molecular databases linking structure images, machine-readable representations, and source-publication information.
• Score: 6.923778751564602
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Optical Chemical Structure Recognition (OCSR) converts 2D molecular depictions in the published literature into SMILES, and is increasingly important for constructing large-scale chemical training datasets. Automation at that scale requires identifying unreliable predictions in the absence of ground truth. Three families of label-free signals were compared on $263$ ACS journal depictions with verified ground truth: model confidence, re-rendering similarity, and agreement among recognizers. Pixel-space re-rendering performed little better than chance (AUROC $0.547$, $95\%$ CI $[0.465,0.629]$), and an oracle-tuned threshold on it reduced correct labels per image from $0.745$ to $0.205$. Agreement among four architecturally distinct recognizers instead reached an AUROC of $0.916$ ($[0.880,0.952]$). The two-of-four rule accepted $81.7\%$ of images at $88.8\%$ precision, the three-of-four rule $52.1\%$ at $98.5\%$. The same pattern held on CLEF-IP, UOB, and USPTO. This distinction is obscured on synthetic benchmarks, where re-rendered predictions naturally resemble their inputs. A substance filter removed $2{,}193$ false agreements on wildcards and R-group fragments, after which the three-of-four rule rejected all $68$ generic depictions. VERDICT was then applied to PMC Open Access, producing $6{,}146$ structure labels for $4{,}833$ molecules; chemist adjudication of $400$ released labels in two independent samples yielded precisions of $0.995$ for the three-of-four tier and $0.958$ for the two-of-four tier. VERDICT therefore enables validated labels for multimodal molecular databases linking structure images, machine-readable representations, and source-publication information. In SES AI's Molecular Universe platform, VERDICT further serves as an image-based interface for searching and retrieving molecular records.

Related papers

• Not All Relations Are Equal: Relation-Balanced and Calibrated Graph Learning for Provenance-Based Intrusion Detection [66.44527094471619]
  We present RECAL, an unsupervised framework using relation-balanced masked graph learning to better capture rare interaction patterns.<n>On three DARPA E3 datasets, RECAL achieves F1 scores of 99.99%, 99.93%, and 99.99%, outperforming the best baseline on each dataset by 0.88, 0.82, and 0.42 percentage points, respectively.
  arXiv  Detail & Related papers  (2026-09-15T00:31:01Z)
• Inter-Rater Reliability of LLM and Rule-Based Annotation for Inferential Narrative Features: Three Studies on a Turkish Corpus [0.0]
  This report answers the question of whether a human would agree with labels in a dataset with automatically generated feature annotations.<n>Three studies are reported. Five machine labellers returned positive rates of $0$, $1$, $40$, $72$ and $78$ out of $100$ scenes, against a human count of $9$.<n>Two readings survive: the feature is genuinely inferential and beyond current automatic detection, or the rule's definition is not yet operational enough for any rater to apply consistently.
  arXiv  Detail & Related papers  (2026-09-12T13:31:30Z)
• OmniMed-FL: A Robust Multimodal Federated Learning Framework for Clinical Diagnosis [17.411567668075577]
  We present OmniMed-FL, a controlled systems study of multimodal learning for five-class clinical condition classification.<n>Our proxy corpus pairs 3,000 public chest radiographs with 3,000 class-FOLD synthetic notes, matched by class, not by patient.<n>As all notes are synthetic and pairing is not patient-level, these are descriptive proxy comparisons, not estimates of diagnostic performance or deployment readiness.
  arXiv  Detail & Related papers  (2026-09-09T15:56:26Z)
• Fixed-order postselected CHSH reference acquisition for parity-constrained spatial-mode qubits on a commercial cloud photonic processor [0.0]
  We report a fixed-order Clauser-Horne-Shimony-Holt (CHSH) acquisition and reporting protocol for two encoded photonic qubits on Quandela's commercial, cloud-accessible Belenos processor.<n>Each logical qubit is a two-dimensional spatial-mode subspace in the seven-dimensional zero-sum sector of an eight-mode single-photon register.
  arXiv  Detail & Related papers  (2026-08-13T01:08:02Z)
• Cross-View Variance Correlation in Path-Traced Stereo:A Hidden Shortcut in Synthetic Training Data [0.0]
  Path-traced synthetic stereo data underlie a large fraction of disparity-estimation training pipelines.<n>We show that the underlying emphvariance fields are highly correlated once aligned by the ground-truth disparity warp.<n>This signal is unique to MC-rendered data and constitutes a candidate sim-to-real shortcut.
  arXiv  Detail & Related papers  (2026-06-24T07:13:00Z)
• A Closed-Form Adaptive-Landmark Kernel for Certified Point-Cloud and Graph Classification [0.0]
  PALACE is the strongest closed-form diagram-based method on OrbitHS5k ($91.3pm 1.0%$, matching Persformer)<n>At $8$ domain inflation, placement maintains $94%$ while the uniform grid collapses to chance ($25%$ on 4-class data)<n> Empirically, PALACE is the strongest closed-form diagram-based method on OrbitHS5k ($91.3pm 1.0%$, matching Persformer)
  arXiv  Detail & Related papers  (2026-05-05T17:59:18Z)
• Learning Hippo: Multi-attractor Dynamics and Stability Effects in a Biologically Detailed CA3 Extension of Hopfield Networks [0.0]
  We present a biologically detailed extension of the classical Hopfield/Marr auto-associative memory model for CA3.<n>We implement ten populations (two asymmetric pyramidal subtypes, eight GABAergic interneuron classes), forty-seven compartments, multi-rule plasticity, and a bimodal cholinergic encoding/consolidation cycle.
  arXiv  Detail & Related papers  (2026-04-22T15:28:17Z)
• A High-Accuracy Optical Music Recognition Method Based on Bottleneck Residual Convolutions [0.036971941442545786]
  Optical Music Recognition aims to convert printed or handwritten music score images into editable symbolic representations.<n>This paper presents an end-to-end OMR framework that combines residual bottleneck convolutions with bidirectional gated recurrent unit (BiGRU)-based sequence modeling.<n> Experimental results on the Camera-PrIMuS and PrIMuS datasets demonstrate the effectiveness of the proposed framework.
  arXiv  Detail & Related papers  (2026-04-07T14:32:16Z)
• High-Dimensional Robust Mean Estimation with Untrusted Batches [38.14592862692954]
  We study high-dimensional mean estimation in a collaborative setting where data is contributed by $N$ users in batches of size $n$.<n>We formalize this challenge through a double corruption landscape: an $varepsilon$-fraction of users are entirely adversarial, while the remaining good'' users provide data from distributions that are related to $P$, but deviate by a proximity parameter $$.<n>Our algorithms achieve the minimax-optimal error rate $O(sqrtvarepsilon/n + sqrtd/nN + s
  arXiv  Detail & Related papers  (2026-02-24T08:59:37Z)
• $β$-CLIP: Text-Conditioned Contrastive Learning for Multi-Granular Vision-Language Alignment [53.42377319350806]
  $$-CLIP is a multi-granular text-conditioned contrastive learning framework.<n>$$-CAL addresses the semantic overlap inherent in this hierarchy.<n>$$-CLIP establishes a robust, adaptive baseline for dense vision-language correspondence.
  arXiv  Detail & Related papers  (2025-12-14T13:03:20Z)
• Information-Guided Diffusion Sampling for Dataset Distillation [44.216998537570866]
  Diffusion models (DMs) have shown promise for this task but struggle in low images-per-class (IPC) settings.<n>We identify two key types of information that a distilled dataset must preserve.<n>Experiments on Tiny ImageNet and ImageNet subsets show that information-guided diffusion sampling (IGDS) significantly outperforms existing methods.
  arXiv  Detail & Related papers  (2025-07-07T02:27:08Z)
• Reasoning to Attend: Try to Understand How <SEG> Token Works [44.33848900059659]
  We show that the $texttSEG>$ token contributes to semantic similarity within image-text pairs.<n>We present READ, which facilitates LMMs' resilient $textbfREA$soning capability of where to atten$textbfD$ under the guidance of highly activated points.
  arXiv  Detail & Related papers  (2024-12-23T17:44:05Z)
• Robust Distortion-free Watermarks for Language Models [85.55407177530746]
  We propose a methodology for planting watermarks in text from an autoregressive language model. We generate watermarked text by mapping a sequence of random numbers to a sample from the language model.
  arXiv  Detail & Related papers  (2023-07-28T14:52:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.