A Novel Dual-Stream Framework for dMRI Tractography Streamline Classification with Joint dMRI and fMRI Data
- URL: http://arxiv.org/abs/2511.18781v1
- Date: Mon, 24 Nov 2025 05:31:47 GMT
- Title: A Novel Dual-Stream Framework for dMRI Tractography Streamline Classification with Joint dMRI and fMRI Data
- Authors: Haotian Yan, Bocheng Guo, Jianzhong He, Nir A. Sochen, Ofer Pasternak, Lauren J O'Donnell, Fan Zhang,
- Abstract summary: We introduce a novel dual-stream streamline classification framework that jointly analyzes dMRI and functional MRI (fMRI) data to enhance the functional coherence of tract parcellation.<n>We demonstrate our method by parcellating the corticospinal tract (CST) into its four somatotopic subdivisions.
- Score: 7.905089752495834
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Streamline classification is essential to identify anatomically meaningful white matter tracts from diffusion MRI (dMRI) tractography. However, current streamline classification methods rely primarily on the geometric features of the streamline trajectory, failing to distinguish between functionally distinct fiber tracts with similar pathways. To address this, we introduce a novel dual-stream streamline classification framework that jointly analyzes dMRI and functional MRI (fMRI) data to enhance the functional coherence of tract parcellation. We design a novel network that performs streamline classification using a pretrained backbone model for full streamline trajectories, while augmenting with an auxiliary network that processes fMRI signals from fiber endpoint regions. We demonstrate our method by parcellating the corticospinal tract (CST) into its four somatotopic subdivisions. Experimental results from ablation studies and comparisons with state-of-the-art methods demonstrate our approach's superior performance.
Related papers
- A Unified Attention U-Net Framework for Cross-Modality Tumor Segmentation in MRI and CT [0.0]
This study presents a unified Attention U-Net architecture trained jointly on MRI (BraTS 2021) and CT (LIDC-IDRI) datasets.<n>Our proposed pipeline incorporates modality-harmonized preprocessing, attention-gated skip connections, and a modality-aware Focal Tversky loss function.
arXiv Detail & Related papers (2026-01-07T23:50:45Z) - Moving Beyond Diffusion: Hierarchy-to-Hierarchy Autoregression for fMRI-to-Image Reconstruction [65.67001243986981]
We propose MindHier, a coarse-to-fine fMRI-to-image reconstruction framework built on scale-wise autoregressive modeling.<n>MindHier achieves superior semantic fidelity, 4.67x faster inference, and more deterministic results than the diffusion-based baselines.
arXiv Detail & Related papers (2025-10-25T15:40:07Z) - Adapting HFMCA to Graph Data: Self-Supervised Learning for Generalizable fMRI Representations [57.054499278843856]
Functional magnetic resonance imaging (fMRI) analysis faces significant challenges due to limited dataset sizes and domain variability between studies.<n>Traditional self-supervised learning methods inspired by computer vision often rely on positive and negative sample pairs.<n>We propose adapting a recently developed Hierarchical Functional Maximal Correlation Algorithm (HFMCA) to graph-structured fMRI data.
arXiv Detail & Related papers (2025-10-05T12:35:01Z) - GRASPing Anatomy to Improve Pathology Segmentation [67.98147643529309]
We introduce GRASP, a modular plug-and-play framework that enhances pathology segmentation models.<n>We evaluate GRASP on two PET/CT datasets, conduct systematic ablation studies, and investigate the framework's inner workings.
arXiv Detail & Related papers (2025-08-05T12:26:36Z) - Tractography-Guided Dual-Label Collaborative Learning for Multi-Modal Cranial Nerves Parcellation [9.144317581156821]
Multi-modal Cranial Nerves parcellation networks have achieved promising segmentation performance.<n>In this work, we propose a tractography-guided Dual-label Collaborative Learning Network (DCLNet) for multi-modal CNs parcellation.
arXiv Detail & Related papers (2025-08-03T04:08:15Z) - PathSegDiff: Pathology Segmentation using Diffusion model representations [63.20694440934692]
We propose PathSegDiff, a novel approach for histopathology image segmentation that leverages Latent Diffusion Models (LDMs) as pre-trained featured extractors.<n>Our method utilizes a pathology-specific LDM, guided by a self-supervised encoder, to extract rich semantic information from H&E stained histopathology images.<n>Our experiments demonstrate significant improvements over traditional methods on the BCSS and GlaS datasets.
arXiv Detail & Related papers (2025-04-09T14:58:21Z) - A Novel Streamline-based diffusion MRI Tractography Registration Method with Probabilistic Keypoint Detection [9.699179134510103]
We propose a novel unsupervised approach using deep learning to perform streamline-based dMRI tractography registration.<n>The overall idea is to identify corresponding keypoint pairs across subjects for spatial alignment of tractography datasets.
arXiv Detail & Related papers (2025-03-04T10:47:10Z) - A Steerable Deep Network for Model-Free Diffusion MRI Registration [4.813333335683418]
We present a novel, deep learning framework for model-free, nonrigid registration of raw diffusion MRI data.<n>This work establishes a foundation for data-driven, geometry-aware dMRI registration directly in the acquisition space.
arXiv Detail & Related papers (2025-01-08T19:18:44Z) - Enhanced MRI Representation via Cross-series Masking [48.09478307927716]
Cross-Series Masking (CSM) Strategy for effectively learning MRI representation in a self-supervised manner.<n>Method achieves state-of-the-art performance on both public and in-house datasets.
arXiv Detail & Related papers (2024-12-10T10:32:09Z) - Anatomy-guided fiber trajectory distribution estimation for cranial
nerves tractography [14.352189425165777]
The complex environment of the skull base leads to ambiguous spatial correspondence between diffusion directions and fiber geometry.
We propose a novel CNs identification framework with anatomy-guided fiber trajectory distribution.
arXiv Detail & Related papers (2024-02-29T05:08:59Z) - Reconstructing the somatotopic organization of the corticospinal tract
remains a challenge for modern tractography methods [55.07297021627281]
The corticospinal tract (CST) is a critically important white matter fiber tract in the human brain that enables control of voluntary movements of the body.
Diffusion MRI tractography is the only method that enables the study of the anatomy and variability of the CST pathway in human health.
arXiv Detail & Related papers (2023-06-09T02:05:40Z) - A Long Short-term Memory Based Recurrent Neural Network for
Interventional MRI Reconstruction [50.1787181309337]
We propose a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling.
The proposed algorithm has the potential to achieve real-time i-MRI for DBS and can be used for general purpose MR-guided intervention.
arXiv Detail & Related papers (2022-03-28T14:03:45Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.