Auditable Emergency Triage for Maternal and Newborn Care in India

• URL: http://arxiv.org/abs/2609.09356v1
• Date: Tue, 08 Sep 2026 18:45:01 GMT
• Title: Auditable Emergency Triage for Maternal and Newborn Care in India
• Abstract summary: Nurses at Noora Health answer more than 50,000 medical queries per month on our WhatsApp-based service.<n>To support them, we built a system that uses a large language model (LLM) to classify whether a message is an emergency.<n>We show that the new system raised recall from 0.565 to 0.810 and F1 from 0.606 to 0.702.
• Score: 1.121169121023536
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: At Noora Health, our nurses answer more than 50,000 medical queries per month on our WhatsApp-based service that provides caregivers with on-demand support. Their most time-critical task is emergency triage: deciding which queries need immediate in-person attention. To support them, we built a system that uses a large language model (LLM) to classify whether a message is an emergency and provide a rationale for interpretability. But the system was opaque: analyzing mistakes meant reading reasoning chains for each message, which is infeasible at our scale. Prompt changes meant re-running a full evaluation to prevent regressions, which was both costly and operationally challenging. Clinicians follow a decision tree to make this call, but it was never documented or passed to the model, which relied on a flat list of danger signs. To address these issues, we decomposed triage into two steps: an LLM extracts canonical symptoms and patient context from the query using a clinician-authored vocabulary, and a deterministic rule engine captures the scenarios that indicate an emergency. We show that the new system raised recall from 0.565 to 0.810 and F1 from 0.606 to 0.702, with structured rules driving most of the accuracy gains while the decomposition provides auditability: clinical experts can inspect each stage of the new system to see whether the query was mistranslated, symptoms were incorrectly extracted, patient context was wrongly inferred, or the necessary rules were missing. They can add new rules independently without causing regressions and avoid running costly evaluations. Since deployment, the new system has triaged 152,421 patient queries and flagged 28,535 (18.7%) as emergencies. The over-escalation rate has been 17.8%, without any increase in missed emergencies. Clinicians have also added 48 new rules since deployment, evidence of the faster correction loop we set out to build.

Related papers

• Beyond the Flag: Clinical Framing Closes the Moderation Gap in Suicide Risk Measurement [0.0]
  We ask how well deployed safety signals recover clinically meaningful severity.<n>We release a benchmark of 516 r/Watch posts rated by a licensed psychiatrist on a four-level ordinal schema.<n>We argue graded severity, not a binary flag, is what a proportionate duty of care requires.
  arXiv  Detail & Related papers  (2026-09-05T21:16:16Z)
• Case2Flow: Bridging Patient Cases and Guideline Flowcharts through Multimodal Retrieval [65.99409194536337]
  Case2Flow is a task designed to retrieve the most relevant guideline flowchart for a given patient case.<n> FlowAtlas is a curated corpus of 202 flowcharts extracted from 2,080 medical guidelines.<n> CRISP is a training-free scoring method that sharpens late-interaction retrieval by suppressing uninformative patches.
  arXiv  Detail & Related papers  (2026-08-26T21:27:22Z)
• Beyond Information Seeking: Severity-Aware Question Supervision for Proactive Medical Dialogue [3.62175729900672]
  We propose Expected-Severity-Risk (ESR), a consequence-aware question-supervision objective that values each candidate by its expected reduction in severity-aware terminal risk.<n>We show that matched ESR supervision reduces mean high-severity diagnostic miss from.0645 to.0455 (-29.5%) and improves mean diagnostic accuracy from.9123 to.9320 while requiring only 0.14 additional questions per dialogue.
  arXiv  Detail & Related papers  (2026-08-25T13:09:45Z)
• Fantastic Adaptive Taxonomies and How to Use Them [100.20614173157708]
  AdaMAST converts execution traces into a compact, evidence-grounded failure taxonomy.<n>No code is hand-authored, no trace human-annotated.<n>In agent-system search, taxonomy-coded diagnoses of failed candidates outperform free-form.
  arXiv  Detail & Related papers  (2026-07-17T17:41:16Z)
• Trivial Prompt Reframing Bypasses Safety Guardrails in Googleś MedGemma-4B [0.0]
  Open-weight medical language models are increasingly used as the base of patient-facing and clinician-support applications.<n>We quantify that gap for MedGemma-4B-it under attacks that require no technical sophistication.
  arXiv  Detail & Related papers  (2026-07-09T18:31:43Z)
• Agentic AI-based Framework for Mitigating Premature Diagnostic Handoff and Silent Hallucination in Healthcare Applications [17.69274632062373]
  Open-ended conversational agents remain prone to two critical failure modes: premature diagnostic handoff and silent clinical hallucinations.<n>We propose a multi-agent framework that addresses both issues by replacing LLM-as-a-judge'' routing with deterministic orchestration constraints.<n>We evaluate the system using simulated patient agents powered by the llama-3.1-70b-instruct model on 150 test cases.
  arXiv  Detail & Related papers  (2026-06-16T15:39:19Z)
• Benchmarking Multi-turn Medical Diagnosis: Hold, Lure, and Self-Correction [72.89352076103889]
  Large language models (LLMs) achieve high accuracy in medical diagnosis when all clinical information is provided in a single turn.<n>We introduce MINT, a high-fidelity, multi-turn medical diagnosis benchmark comprising 1,035 cases.<n>We uncover three persistent behavioral patterns that significantly impact diagnostic decisions.
  arXiv  Detail & Related papers  (2026-04-06T00:23:10Z)
• From Conflict to Consensus: Boosting Medical Reasoning via Multi-Round Agentic RAG [65.0203623486525]
  Large Language Models (LLMs) exhibit high reasoning capacity in medical question-answering.<n>Their tendency to produce hallucinations and outdated knowledge poses critical risks in healthcare fields.<n>Existing methods rely on noisy token-level signals and lack the multi-round refinement required for complex reasoning.
  arXiv  Detail & Related papers  (2026-02-06T08:25:30Z)
• A Granular Study of Safety Pretraining under Model Abliteration [64.24346997570275]
  We study model abliteration, a lightweight projection technique designed to remove refusal-sensitive directions.<n>We issue 100 prompts with balanced harmful and harmless cases, classify responses as **Refusal** or **Non-Refusal** using multiple judges, and validate judge fidelity.<n>Our study produces a checkpoint-level characterization of which data-centric safety components remain robust under abliteration.
  arXiv  Detail & Related papers  (2025-10-03T07:01:45Z)
• A Locally Executable AI System for Improving Preoperative Patient Communication: A Multi-Domain Clinical Evaluation [1.9205944025326396]
  LENOHA is a safety-first, local-first system that routes inputs with a high-precision sentence-transformer constraints.<n>It returns verbatim answers from a clinician-curated FAQ for clinical queries.<n>Energy logging shows that the non-generative clinical path consumes 1.0 mWh per input versus 168 mWh per small-talk reply.
  arXiv  Detail & Related papers  (2025-10-02T04:53:11Z)
• Transforming unstructured voice and text data into insight for paramedic emergency service using recurrent and convolutional neural networks [68.8204255655161]
  Paramedics often have to make lifesaving decisions within a limited time in an ambulance. This study aims to automatically fuse voice and text data to provide tailored situational awareness information to paramedics.
  arXiv  Detail & Related papers  (2020-05-30T06:47:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.