Human-in-the-Loop Multi-Agent Ventilator Decision Support with Contextual Bandit Preference Learning
- URL: http://arxiv.org/abs/2605.23320v1
- Date: Fri, 22 May 2026 07:36:26 GMT
- Title: Human-in-the-Loop Multi-Agent Ventilator Decision Support with Contextual Bandit Preference Learning
- Abstract summary: Ventilator decision support requires sequential decisions that track evolving physiology and disease trajectories.<n>We propose the Ventilator Decision Support System (VDSS), a human in the loop multi agent framework that coordinates modular decision components.
- Score: 15.41239614844415
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Ventilator decision support requires sequential decisions that track evolving physiology and disease trajectories while respecting safety boundaries and clinician specific tuning styles. Rule based approaches rarely generalize personalization, and end to end reinforcement learning or single large language model systems remain difficult to control and audit. We propose the Ventilator Decision Support System (VDSS), a human in the loop multi agent framework that coordinates modular decision components through contract driven structured interfaces and produces traceable evidence for review. VDSS performs online preference adaptation with a contextual bandit, updating clinician specific preferences from the final accepted decision at each adjustment cycle and using them to guide subsequent recommendations. Structured rejection feedback triggers targeted replanning to reduce unproductive iterations and improve interaction stability. Retrospective ICU trajectory replay with expert review indicates higher recommendation acceptability and fewer interaction rounds to reach an acceptable plan, supporting clinically deployable human AI collaboration.
Related papers
- Adaptive Arena-based Contestable Argumentative Network-of-Experts for Open-Ended Care Plan Coordination [1.4988096015658898]
We present CANOE (Contestable Argumentative Network-of-Experts), a multi-agent neuro-symbolic framework.<n>It addresses limitations through five modules: complexity assessment, adaptive team recruitment, role-based argumentative computation, and care-plan synthesis.<n>CanOE's argumentative structure provides faithful explanation and human contestability.
arXiv Detail & Related papers (2026-08-05T20:18:45Z) - Spectral Biclustering-Driven Scalability for Post-Hoc Explainability in Recommender Systems [0.3437656066916039]
This paper introduces a block-deletion diagnostic framework that uses spectral biclustering to group users and items and then removes entire blocks of interactions.<n>It produces explanations at the level of user segments, item groups, and their interactions.<n>Results show that top-ranked recommendations are often more sensitive to specific interaction blocks than lower-ranked ones.
arXiv Detail & Related papers (2026-07-21T15:22:12Z) - Exploring Agentic Tool-Calling Decisions via Uncertainty-Aligned Reinforcement Learning [63.24624171679711]
Large language model (LLM)-based agents often make suboptimal tool-use decisions.<n>We propose TRUST, which incorporates uncertainty quantification into reward design as a repulsive force for maintaining uncertainty separation.
arXiv Detail & Related papers (2026-06-05T07:08:34Z) - Towards a Virtual Neuroscientist: Autonomous Neuroimaging Analysis via Multi-Agent Collaboration [53.772014300855375]
We introduce NIAgent, a multi-agent system for autonomous end-to-end neuroimaging analysis.<n>Unlike conventional flat tool-calling agents, NIAgent adopts a code-centric execution paradigm.<n>We propose a hierarchical verification framework for autonomous quality control, integrating cohort-level metric screening with agentic visual inspection.
arXiv Detail & Related papers (2026-05-10T06:30:19Z) - Green Shielding: A User-Centric Approach Towards Trustworthy AI [19.485991712624095]
Green Shielding is a user-centric agenda for building evidence-backed deployment guidance.<n>We instantiate Green Shielding in medical diagnosis through HealthCareMagic-Diagnosis.<n>Although instantiated here in medical diagnosis, the agenda extends naturally to other decision-support settings and agentic AI systems.
arXiv Detail & Related papers (2026-04-27T17:04:17Z) - Self-Distilled Reinforcement Learning for Co-Evolving Agentic Recommender Systems [47.428704670017765]
Large language model-empowered agentic recommender systems (ARS) reformulate recommendation as a multi-turn interaction between a recommender agent and a user agent.<n>Existing ARS are mainly optimized in a Reflexion-style paradigm, where past interaction trajectories are stored as textual memory.<n>We propose CoARS, a self-distilled reinforcement learning framework for co-evolving agentic recommender systems.
arXiv Detail & Related papers (2026-04-11T04:52:38Z) - Care-Conditioned Neuromodulation for Autonomy-Preserving Supportive Dialogue Agents [3.7958475517455947]
We introduce Care-Conditioned Neuromodulation (CCN), a state-dependent control framework.<n>We define a utility function that rewards autonomy support and helpfulness while penalizing dependency and coercion.<n>These results suggest that state-dependent control combined with utility-based selection is a practical approach to multi-objective alignment in autonomy-sensitive dialogue.
arXiv Detail & Related papers (2026-04-02T03:44:58Z) - DARC: Disagreement-Aware Alignment via Risk-Constrained Decoding [59.16244104797919]
We propose **Disagreement-Aware Alignment via Risk-Constrained Decoding (DARC)**.<n>DARC frames response selection as distributionally robust, risk-sensitive decision making.<n>Experiments on alignment benchmarks show that DARC reduces disagreement and tail risk while maintaining competitive average quality.
arXiv Detail & Related papers (2026-03-09T09:21:29Z) - Continuous Telemonitoring of Heart Failure using Personalised Speech Dynamics [17.682803546212824]
We propose a Longitudinal Intra-Patient Tracking (LIPT) scheme to capture the trajectory of relative symptomatic changes within individuals.<n>Central to this framework is a Sequential Personalised (PSE) which transforms longitudinal speech recordings into context-aware latent representations.<n> Experimental results from a cohort of 225 patients demonstrate that the LIPT paradigm significantly outperforms the classic cross-sectional approaches.
arXiv Detail & Related papers (2026-02-23T10:19:17Z) - TRACE: Temporal Reasoning via Agentic Context Evolution for Streaming Electronic Health Records (EHRs) [7.2159153945746795]
Large Language Models (LLMs) encode extensive medical knowledge but struggle to apply it reliably to longitudinal patient trajectories.<n>We introduce TRACE, a framework that enables temporal clinical reasoning with frozen LLMs.<n> evaluated on longitudinal clinical event streams from MIMIC-IV.
arXiv Detail & Related papers (2026-02-13T11:39:19Z) - Silence is Not Consensus: Disrupting Agreement Bias in Multi-Agent LLMs via Catfish Agent for Clinical Decision Making [80.94208848596215]
We present a new concept called Catfish Agent, a role-specialized LLM designed to inject structured dissent and counter silent agreement.<n>Inspired by the catfish effect'' in organizational psychology, the Catfish Agent is designed to challenge emerging consensus to stimulate deeper reasoning.
arXiv Detail & Related papers (2025-05-27T17:59:50Z) - Empowering Clinicians with Medical Decision Transformers: A Framework for Sepsis Treatment [5.0005174003014865]
We propose the medical decision transformer (MeDT) to solve tasks in safety-critical settings.
MeDT uses the decision transformer architecture to learn a policy for drug dosage recommendation.
MeDT captures complex dependencies among a patient's medical history, treatment decisions, outcomes, and short-term effects on stability.
arXiv Detail & Related papers (2024-07-28T03:40:00Z) - Online Decision Mediation [72.80902932543474]
Consider learning a decision support assistant to serve as an intermediary between (oracle) expert behavior and (imperfect) human behavior.
In clinical diagnosis, fully-autonomous machine behavior is often beyond ethical affordances.
arXiv Detail & Related papers (2023-10-28T05:59:43Z) - Causal Disentangled Variational Auto-Encoder for Preference
Understanding in Recommendation [50.93536377097659]
This paper introduces the Causal Disentangled Variational Auto-Encoder (CaD-VAE), a novel approach for learning causal disentangled representations from interaction data in recommender systems.
The approach utilizes structural causal models to generate causal representations that describe the causal relationship between latent factors.
arXiv Detail & Related papers (2023-04-17T00:10:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.