MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognition

• URL: http://arxiv.org/abs/2606.14459v1
• Date: Fri, 12 Jun 2026 13:50:09 GMT
• Title: MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognition
• Abstract summary: We argue that model robustness can be treated as a dynamic capability that continually develops.<n>We propose a real-world-inspired continual learning curriculum to simulate incremental updates.
• Score: 9.310155608815283
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Modern Automatic Speech Recognition (ASR) systems have made remarkable progress on standard benchmarks, yet performance gaps have emerged under real-world distribution shifts, caused by recording conditions, accents, speech impairments, and noise. Existing datasets and benchmarks typically isolate these factors, which overlooks their co-occurrence in real-world applications. In this paper, we argue that model robustness can be treated as a dynamic capability that continually develops, and we introduce MoDiCoL, a Modular Diagnostic Continual Learning dataset designed for controlled analysis of linguistic content, speaker characteristics, and acoustic environments. Furthermore, we propose a real-world-inspired continual learning curriculum to simulate incremental updates and study how robustness is acquired, transferred, and forgotten. We evaluate three continual learning strategies and provide detailed insights into robustness under evolving conditions.

Related papers

• LLM-Based Synthetic Ground Truth Generation for Audio-Based Emotion Classification via In-Context Learning [9.928781897312971]
  We propose a large language model (LLM)-driven, agentic inference workflow for emotion-related synthetic ground truth generation from streaming speech data in VR environments.<n>We use In-Context Learning (ICL) with few-shot demonstrations of paired audio-based samples and their corresponding transcriptions to construct informative and robust in-context prompts.
  arXiv  Detail & Related papers  (2026-06-10T11:08:21Z)
• Model-Based Reinforcement Learning for Control under Time-Varying Dynamics [40.96573079787976]
  We study reinforcement learning for control under time-varying dynamics.<n>We propose a practical optimistic model-based reinforcement learning algorithm with adaptive data buffer mechanisms.
  arXiv  Detail & Related papers  (2026-04-02T16:52:59Z)
• Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams [78.9560820155271]
  We evaluate online adaptation over streaming, continually updating knowledge.<n> OAKS comprises two datasets: OAKS-BABI and OAKS-Novel.<n>Both state-of-the-art models and agentic memory systems fail to adapt robustly on OAKS.
  arXiv  Detail & Related papers  (2026-03-08T00:38:39Z)
• Boosting ASR Robustness via Test-Time Reinforcement Learning with Audio-Text Semantic Rewards [8.109014000578766]
  We present ASR-TRA, a novel Testtime Reinforcement Adaptation framework inspired by causal intervention.<n>Our method achieves higher accuracy while maintaining lower latency than existing TTA baselines.<n>Our approach provides a practical and robust solution for deploying ASR systems in challenging real-world conditions.
  arXiv  Detail & Related papers  (2026-03-05T14:43:15Z)
• Modular Memory is the Key to Continual Learning Agents [100.09688599754465]
  We argue that combining the strengths of In-Weight Learning (IWL) and the newly emerged capabilities of In-Context Learning (ICL) through the design of modular memory is the missing piece for continual adaptation at scale.<n>We outline a conceptual framework for modular memory-centric architectures that leverage ICL for rapid adaptation and knowledge accumulation, and IWL for stable updates to model capabilities.
  arXiv  Detail & Related papers  (2026-03-02T11:40:05Z)
• Refining Context-Entangled Content Segmentation via Curriculum Selection and Anti-Curriculum Promotion [14.803333807611414]
  CurriSeg is a dual-phase learning framework that unifies curriculum and anti-curriculum principles to improve representation reliability.<n>In the Curriculum Selection phase, CurriSeg dynamically selects training data based on the temporal statistics of sample losses.<n>In the Anti-Curriculum Promotion phase, we design Spectral-Blindness Fine-Tuning, which suppresses high-frequency components to enforce dependence on low-frequency structural and contextual cues.
  arXiv  Detail & Related papers  (2026-02-01T12:12:24Z)
• Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting [70.83781268763215]
  Vision-language models (VLMs) have achieved impressive performance across diverse multimodal tasks by leveraging large-scale pre-training.<n>VLMs face unique challenges such as cross-modal feature drift, parameter interference due to shared architectures, and zero-shot capability erosion.<n>This survey aims to serve as a comprehensive and diagnostic reference for researchers developing lifelong vision-language systems.
  arXiv  Detail & Related papers  (2025-08-06T09:03:10Z)
• Stochastic Encodings for Active Feature Acquisition [100.47043816019888]
  Active Feature Acquisition is an instance-wise, sequential decision making problem.<n>The aim is to dynamically select which feature to measure based on current observations, independently for each test instance.<n>Common approaches either use Reinforcement Learning, which experiences training difficulties, or greedily maximize the conditional mutual information of the label and unobserved features, which makes myopic.<n>We introduce a latent variable model, trained in a supervised manner. Acquisitions are made by reasoning about the features across many possible unobserved realizations in a latent space.
  arXiv  Detail & Related papers  (2025-08-03T23:48:46Z)
• Reinforced Interactive Continual Learning via Real-time Noisy Human Feedback [59.768119380109084]
  This paper introduces an interactive continual learning paradigm where AI models dynamically learn new skills from real-time human feedback.<n>We propose RiCL, a Reinforced interactive Continual Learning framework leveraging Large Language Models (LLMs)<n>Our RiCL approach substantially outperforms existing combinations of state-of-the-art online continual learning and noisy-label learning methods.
  arXiv  Detail & Related papers  (2025-05-15T03:22:03Z)
• Time Will Change Things: An Empirical Study on Dynamic Language Understanding in Social Media Classification [5.075802830306718]
  We empirically study social media NLU in a dynamic setup, where models are trained on the past data and test on the future. We show that auto-encoding and pseudo-labeling collaboratively show the best robustness in dynamicity.
  arXiv  Detail & Related papers  (2022-10-06T12:18:28Z)
• Meta-learning using privileged information for dynamics [66.32254395574994]
  We extend the Neural ODE Process model to use additional information within the Learning Using Privileged Information setting. We validate our extension with experiments showing improved accuracy and calibration on simulated dynamics tasks.
  arXiv  Detail & Related papers  (2021-04-29T12:18:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.