AI_LectureNote: A Retrospective Pilot Study of a Post-ASR Workflow for English-Script Rendering and Semantic Drift in Korean-English Medical Lectures
- URL: http://arxiv.org/abs/2607.17237v1
- Date: Sun, 19 Jul 2026 13:02:07 GMT
- Title: AI_LectureNote: A Retrospective Pilot Study of a Post-ASR Workflow for English-Script Rendering and Semantic Drift in Korean-English Medical Lectures
- Abstract summary: AI_LectureNote is a readability-oriented post-ASR workflow for Korean-English medical lectures.<n>It rewrites speech-to-text output into study transcripts while restoring Latin-script medical terms.
- Score: 1.7028841264419619
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: AI_LectureNote is a historical, readability-oriented post-ASR workflow for Korean-English medical lectures. It rewrites speech-to-text output into study transcripts while restoring Latin-script medical terms rather than Korean phonetic transliterations. We retrospectively evaluate the workflow on four author-recorded lectures across five conditions. In this pilot, post-processing raised the macro English-script rendering rate from 0.39 to 0.71 on the whisper-1 path and from 0.26 to 0.65 when applied to 3-minute chunked gpt-4o-transcribe output. However, English-script rendering did not imply semantic faithfulness: the two post-processed conditions showed semantic drift in 34 and 36 of 282 reference sentences and polarity failures in 11 and 13 of 101 polarity-cue rows. A descriptive cross-input comparison suggested different candidate failure patterns: polarity-failure sets overlapped more strongly across front-ends (Jaccard 0.60; 9 shared of 15 unioned failures) than general semantic-drift sets (Jaccard 0.23; 13 shared of 57 unioned drifts). This single-annotator pilot documents concrete failure modes rather than population rates and supports evaluating surface accuracy, term-script rendering, chunk-level script consistency, and medical-meaning preservation separately.
Related papers
- What Counts as a Mistake? Annotating Recitation Events in Quran Memorization Transcripts [2.627150003429427]
We report a completed human annotation of 100 production recording cases.<n>In a preliminary pilot, eight single 20-minute runs across three coding agents and eight models span label-aware F1 0.143 to 0.892.<n>Seven of 162 events defeat all six same-day runs, five of them one orthographic rule, and the strongest run still misses the same ones.
arXiv Detail & Related papers (2026-09-10T18:11:41Z) - IndicQE-APE: A Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages [77.88427845181154]
We consolidate the WMT 2020--2024 shared-task lineage with an extended English--Malayalam resource into indicqe: $126,754$ instances over nine directional pairs.<n>We benchmark six prompted LLMs and three COMET metrics on segment-level QE, and three systems on APE.
arXiv Detail & Related papers (2026-08-17T09:50:52Z) - Interpretable Cross-Lingual Alignment in Small Language Models: Probing Cultural and Pragmatic Reasoning in Japanese-English Bilingual LLMs [0.0]
I introduce J-PragEval-v0, a minimal-pair benchmark isolating four phenomena from surface fluency.<n>I combine it with linear probes and teacher-forced log-probability evaluation to ask where inside TinySwallow-1.5B the corresponding contrasts live.
arXiv Detail & Related papers (2026-08-14T21:04:21Z) - Stoicheia: Character-Level Masked Diffusion for Ancient Greek Textual Restoration, Parsing, and Metrical Scansion [0.0]
Stoicheia is a character-level masked-diffusion encoder for Ancient Greek.<n>We pretrain it on an open, revision-pinned corpus of 380M words and release eleven checkpoints.<n>On Ithaca's own test split, with identical frozen samples and strict scoring, Stoicheia reduces character error relative to both prior state-of-the-art systems.
arXiv Detail & Related papers (2026-08-07T14:07:43Z) - LV-ROVER-MLT: Low-Resource Maltese OCR by Multi-Stream Voting [0.0]
This paper reports results on a benchmark against a fine-tuned Tesseract baseline with a character error rate of 0.0234.<n> Ensemble recognition alone, scored under the same label convention as the baseline, improves character error rate by 44 percent to 0.01317.<n>A post-processing chain that aligns Tesseract's straight-quote and dash output to the benchmark's curly-quote convention, plus one stage that recovers misread diacritics, brings the full pipeline to a character error rate of 0.00700.
arXiv Detail & Related papers (2026-06-30T22:58:41Z) - Jury Duty: Calibration and Orientation Failures in MLLM-as-a-Judge Under Cultural Ambiguity [43.23157850664282]
We introduce VOIR DIRE, a multimodal benchmark of 626 culturally paired image-prompt artifacts spanning U.S. and mainland Chinese contexts.<n>Across six MLLMs, the bias decomposes into two failures: a positivity-floor calibration failure and an orientation failure.<n>We recommend reporting alignment against each reference pool separately and treating cross-pool divergence as a judge property.
arXiv Detail & Related papers (2026-06-12T15:53:40Z) - Benchmarking Speech-to-Speech Translation Models [55.00303727199927]
Speech-to-speech translation (S2ST) has advanced rapidly, but offline evaluation lacks a unified protocol.<n>We introduce a benchmarking framework integrating 46 metrics across eight dimensions.<n>We deploy it on 1,248 model-language configurations from FLEURS and CVSS.
arXiv Detail & Related papers (2026-06-02T07:01:33Z) - The Digital Afterlife of Empires: Four Language Models Converge on the Same Imperial Cartography of Writing [0.0]
Large language models process the world's writing systems with radical inequality.<n>Only 29 scripts (9.7%) are fully supported by contemporary digital infrastructure; among 158 living scripts, 60 (38.0%) lack complete support.<n> Tokenizer efficiency varies by a factor of 31.7 across 45 scripts measured with parallel text.
arXiv Detail & Related papers (2026-04-30T07:02:45Z) - A Grammar of Machine Learning Workflows [0.0]
This paper proposes a structural remedy: a grammar that decomposes the supervised learning lifecycle into 8 kernel primitives connected by a typed directed acyclic graph (DAG)<n>The grammar's core contribution is the terminal assess constraint, where repeated test-set assessment is rejected by a guard on a nominally distinct Evidence type.
arXiv Detail & Related papers (2026-03-11T13:15:33Z) - From Black Box to Glass Box: Cross-Model ASR Disagreement to Prioto Review in Ambient AI Scribe Documentation [43.148402136307716]
Cross-model disagreement among heterogeneous ASR systems can act as a reference-free uncertainty signal.<n>We transcribed 50 publicly available medical audio clips with eight ASR systems spanning commercial APIs and open-source engines.<n>Low-agreement regions were enriched for content disagreements, with the content fraction increasing from 53.9% to 73.9% across quintiles of high-risk mass.
arXiv Detail & Related papers (2026-03-02T13:02:13Z) - Generating Natural-Language Surgical Feedback: From Structured Representation to Domain-Grounded Evaluation [66.7752700084159]
High-quality feedback from a surgical trainer is pivotal for improving trainee performance and long-term skill acquisition.<n>We present a structure-aware pipeline that learns a surgical action ontology from real trainer-to-trainee transcripts.
arXiv Detail & Related papers (2025-11-19T06:19:34Z) - ATRI: Mitigating Multilingual Audio Text Retrieval Inconsistencies by Reducing Data Distribution Errors [42.469131776062724]
Existing Multilingual audio-text retrieval schemes suffer from inconsistencies for instance similarity matching across languages.<n>We propose a consistent ML-ATR scheme using 1-to-k contrastive learning and audio-English co-anchor contrastive learning.<n>Our scheme achieves state-of-the-art performance on recall and consistency metrics for eight mainstream languages, including English.
arXiv Detail & Related papers (2025-02-20T15:06:15Z) - Phonology-Guided Speech-to-Speech Translation for African Languages [2.7624021966289605]
We present a prosody-guided framework for speech-to-speech translation (S2ST)<n>We show that emphwithin-phylum language pairs exhibit 30--40% lower pause and over 3$times$ higher onset/offset correlation compared to cross-phylum pairs.<n>We also release a three-tier, transcript-free BLEU suite (M1--M3) that correlates strongly with human judgments.
arXiv Detail & Related papers (2024-10-30T09:44:52Z) - Adversarial Training For Low-Resource Disfluency Correction [50.51901599433536]
We propose an adversarially-trained sequence-tagging model for Disfluency Correction (DC)
We show the benefit of our proposed technique, which crucially depends on synthetically generated disfluent data, by evaluating it for DC in three Indian languages.
Our technique also performs well in removing stuttering disfluencies in ASR transcripts introduced by speech impairments.
arXiv Detail & Related papers (2023-06-10T08:58:53Z) - Subword Segmentation and a Single Bridge Language Affect Zero-Shot
Neural Machine Translation [36.4055239280145]
We investigate zero-shot performance of a multilingual EN$leftrightarrow$FR,CS,DE,FI system trained on WMT data.
We observe a bias towards copying the source in zero-shot translation, and investigate how the choice of subword segmentation affects this bias.
arXiv Detail & Related papers (2020-11-03T13:45:54Z) - Leveraging Discourse Rewards for Document-Level Neural Machine
Translation [46.006636555165414]
We propose a training approach that explicitly optimize two established discourse metrics, lexical cohesion (LC) and coherence (COH)
Our training approach has been able to achieve more cohesive and coherent document translations than other competitive approaches.
arXiv Detail & Related papers (2020-10-08T02:26:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.