InsightBoard: An Interactive Multi-Metric Visualization and Fairness Analysis Plugin for TensorBoard
- URL: http://arxiv.org/abs/2604.03323v1
- Date: Thu, 02 Apr 2026 17:35:38 GMT
- Title: InsightBoard: An Interactive Multi-Metric Visualization and Fairness Analysis Plugin for TensorBoard
- Abstract summary: We present InsightBoard, a plugin that integrates synchronized multi-metric visualization with subgroup diagnostics in a unified interface.<n>By making fairness diagnostics available during training, InsightBoard supports earlier, more informed model inspection without modifying existing training pipelines or introducing additional data stores.
- Score: 3.409008933025072
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Modern machine learning systems deployed in safety-critical domains require visibility not only into aggregate performance but also into how training dynamics affect subgroup fairness over time. Existing training dashboards primarily support single-metric monitoring and offer limited support for examining relationships between heterogeneous metrics or diagnosing subgroup disparities during training. We present InsightBoard, an interactive TensorBoard plugin that integrates synchronized multi-metric visualization with slice-based fairness diagnostics in a unified interface. InsightBoard enables practitioners to jointly inspect training dynamics, performance metrics, and subgroup disparities through linked multi-view plots, correlation analysis, and standard group fairness indicators computed over user-defined slices. Through case studies with YOLOX on the BDD100k dataset, we demonstrate that models achieving strong aggregate performance can still exhibit substantial demographic and environmental disparities that remain hidden under conventional monitoring. By making fairness diagnostics available during training, InsightBoard supports earlier, more informed model inspection without modifying existing training pipelines or introducing additional data stores.
Related papers
- Beyond Independence: Learning Correlated Views for Variational Incomplete Multi-View Clustering [15.204251218204542]
Incomplete multi-view clustering (IMVC) aims to uncover shared cluster structures from data with partially observed views.<n>We propose a variational framework that explicitly goes beyond this assumption by introducing a learnable cross-view correlation structure.<n>Our method consistently outperforms state-of-the-art approaches across diverse missing-view settings.
arXiv Detail & Related papers (2026-08-16T14:16:24Z) - Cross-modal Affinity-aligned Multimodal Learning Analytics for Predicting Student Collaboration Satisfaction in Game-Based Learning [3.37216674402797]
In educational deployments, individual modalities such as eye gaze exhibit inconsistent informativeness across student cohorts.<n>We propose the Affinity-Aligned Multimodal Learning Analytics framework, whose core contribution is the Cross-modal Affinity-guided Modality Alignment module.
arXiv Detail & Related papers (2026-05-16T04:22:47Z) - VISTA: Video Interaction Spatio-Temporal Analysis Benchmark [47.42490151556478]
We introduce VISTA, a benchmark for open-set, multi-action-temporal understanding in Vision-Language Models (VLMs)<n>Our benchmark integrates multiple datasets into a single interaction-aware benchmarks and comprises 12K curated video- pairs.<n>Overall, VISTA is the first, large-scale, interaction-aware diagnostic benchmark fortemporal understanding inVLMss.
arXiv Detail & Related papers (2026-05-02T11:28:20Z) - CLIP-Guided Adaptable Self-Supervised Learning for Human-Centric Visual Tasks [76.00315860962885]
We propose CLASP (CLIP-guided Adaptable Self-suPervised learning), a novel framework for unsupervised pre-training in human-centric visual tasks.<n> CLASP leverages the powerful vision-language model CLIP to generate both low-level (e.g., body parts) and high-level (e.g., attributes) semantic pseudo-labels.<n>MoE dynamically adapts feature extraction based on task-specific prompts, mitigating potential feature conflicts and enhancing transferability.
arXiv Detail & Related papers (2026-01-19T15:19:28Z) - Real-Time Multimodal Data Collection Using Smartwatches and Its Visualization in Education [0.0]
This paper presents Watch-DMLT, a data acquisition application for Fitbit Sense 2 smartwatches, and ViSeDOPS, a dashboard-based visualization system for analyzing synchronized multimodal data collected during oral presentations.<n>We report on a classroom deployment involving 65 students and up to 16 smartwatches, where data streams including heart rate, motion, gaze, video, and contextual annotations were captured and analyzed. Results demonstrate the feasibility and utility of the proposed system for supporting fine-grained, scalable, and interpretable Multimodal Learning Analytics in real learning environments.
arXiv Detail & Related papers (2025-12-02T11:12:46Z) - Unleashing the Power of Vision-Language Models for Long-Tailed Multi-Label Visual Recognition [55.189113121465816]
We propose a novel correlation adaptation prompt network (CAPNET) for long-tailed multi-label visual recognition.<n>CAPNET explicitly models correlations from CLIP's textual encoder.<n>It improves generalization through test-time ensembling and realigns visual-textual modalities.
arXiv Detail & Related papers (2025-11-25T18:57:28Z) - View-aware Cross-modal Distillation for Multi-view Action Recognition [7.312418283882337]
We propose View-aware Cross-modal Knowledge Distillation (ViCoKD) to distill knowledge from a fully supervised multi-modal teacher to a modality- and annotation-limited student.<n>ViCoKD employs a cross-modal adapter with cross-modal attention, allowing the student to exploit multi-modal correlations while operating with incomplete modalities.<n>We also propose a View-aware Consistency module to address view misalignment, where the same action may appear differently or only partially across viewpoints.
arXiv Detail & Related papers (2025-11-17T02:00:22Z) - VLSlice: Interactive Vision-and-Language Slice Discovery [17.8634551024147]
VLSlice is an interactive system enabling user-guided discovery of coherent representation-level subgroups with consistent visiolinguistic behavior.
We show that VLSlice enables users to quickly generate diverse high-coherency slices in a user study and release the tool publicly.
arXiv Detail & Related papers (2023-09-13T04:02:38Z) - Self-aware and Cross-sample Prototypical Learning for Semi-supervised
Medical Image Segmentation [10.18427897663732]
Consistency learning plays a crucial role in semi-supervised medical image segmentation.
It enables the effective utilization of limited annotated data while leveraging the abundance of unannotated data.
We propose a self-aware and cross-sample prototypical learning method ( SCP-Net) to enhance the diversity of prediction in consistency learning.
arXiv Detail & Related papers (2023-05-25T16:22:04Z) - Continual Vision-Language Representation Learning with Off-Diagonal
Information [112.39419069447902]
Multi-modal contrastive learning frameworks like CLIP typically require a large amount of image-text samples for training.
This paper discusses the feasibility of continual CLIP training using streaming data.
arXiv Detail & Related papers (2023-05-11T08:04:46Z) - Visual Auditor: Interactive Visualization for Detection and
Summarization of Model Biases [18.434430375939755]
As machine learning (ML) systems become increasingly widespread, it is necessary to audit these systems for biases prior to their deployment.
Recent research has developed algorithms for effectively identifying intersectional bias in the form of interpretable, underperforming subsets (or slices) of the data.
We propose Visual Auditor, an interactive visualization tool for auditing and summarizing model biases.
arXiv Detail & Related papers (2022-06-25T02:48:27Z) - Dense Contrastive Visual-Linguistic Pretraining [53.61233531733243]
Several multimodal representation learning approaches have been proposed that jointly represent image and text.
These approaches achieve superior performance by capturing high-level semantic information from large-scale multimodal pretraining.
We propose unbiased Dense Contrastive Visual-Linguistic Pretraining to replace the region regression and classification with cross-modality region contrastive learning.
arXiv Detail & Related papers (2021-09-24T07:20:13Z) - A Variational Information Bottleneck Approach to Multi-Omics Data
Integration [98.6475134630792]
We propose a deep variational information bottleneck (IB) approach for incomplete multi-view observations.
Our method applies the IB framework on marginal and joint representations of the observed views to focus on intra-view and inter-view interactions that are relevant for the target.
Experiments on real-world datasets show that our method consistently achieves gain from data integration and outperforms state-of-the-art benchmarks.
arXiv Detail & Related papers (2021-02-05T06:05:39Z) - DiVA: Diverse Visual Feature Aggregation for Deep Metric Learning [83.48587570246231]
Visual Similarity plays an important role in many computer vision applications.
Deep metric learning (DML) is a powerful framework for learning such similarities.
We propose and study multiple complementary learning tasks, targeting conceptually different data relationships.
We learn a single model to aggregate their training signals, resulting in strong generalization and state-of-the-art performance.
arXiv Detail & Related papers (2020-04-28T12:26:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.