Search bioRxiv⌕ Search

Biology subjects

Jagad, C.

Publications and source records attributed to Jagad, C..

5 recordsLinked to original sources

Using Diffusion Transformers to Generate Synthetic Diffusion Scalar Maps for Data Augmentation

Generation of high-quality synthetic brain MRI data could be beneficial for advancing neuroimaging research, particularly when access to large-scale, labeled datasets is limited. In this work, we leverage a pretrained Diffusion Transformer (DiT) architecture to synthesize 3D mean diffusivity (MD) scalar maps from the Cam-CAN dataset. To adapt the DiT model--originally trained on 2D natural images--for 3D neuroimaging data, we implemented a preprocessing strategy that tiles 2D slices from 3D volumes into composite 2D images, enabling effective finetuning. The quality of the generated synthetic images was evaluated using Multi-Scale Structural Similarity (MS-SSIM) and Maximum Mean Discrepancy (MMD) metrics, demonstrating high fidelity and anatomical coherence. To assess the utility of synthetic data in downstream tasks, we conducted transfer learning experiments for dementia classification on the ADNI dataset. A sex classification model, trained on both real and synthetic Cam-CAN data, was repurposed for this task, showing that synthetic samples can enhance model performance. These results highlight the potential of diffusion-based generative models for augmenting neuroimaging datasets and supporting clinical applications.

neuroscience↗

Synthetic Diffusion Tensor Imaging Maps Generated by 2D and 3D Probabilistic Diffusion Models: Evaluation and Applications

Diffusion tensor imaging (DTI) is a key neuroimaging modality for assessing brain tissue microstructure, yet high-quality acquisitions are costly, time-intensive, and prone to artifacts. To address data scarcity and privacy concerns - and to augment the available data for training deep learning methods - synthetic DTI generation has gained interest. Specifically, denoising diffusion probabilistic models (DDPMs) have emerged as a promising approach due to their superior fidelity, diversity, controllability, and stability compared to generative adversarial networks (GANs) and variational autoencoders (VAEs). In this work, we evaluate the quality, fidelity and added value for downstream applications of synthetic DTI mean diffusivity (MD) maps generated by 2D slice-wise and 3D volume-wise DDPMs. We evaluate their computational efficiency and utility for data augmentation in two downstream tasks: sex classification and dementia classification using 2D and 3D convolutional neural networks (CNNs). Our findings show that 3D synthesis outperforms 2D slice-wise generation in downstream tasks. We present a benchmark analysis of synthetic diffusion-weighted imaging approaches, highlighting key trade-offs in image quality, diversity, efficiency, and downstream performance.

neuroscience↗

Parameter Efficient Fine-tuning of Transformer-based Masked Autoencoder Enhances Resource Constrained Neuroimage Analysis

Recent innovations in artificial intelligence (AI) have increasingly focused on large-scale foundational models that are more general purpose in contrast to conventional models trained to perform specialized tasks. Transformer-based architectures have become the standard backbone in foundation models across data modalities (image, text, audio, video). There has been a keen interest in applying parameter-efficient fine-tuning (PEFT) methods to adapt these models to specialized downstream tasks in language and vision. These methods are particularly essential for medical image analysis where the limited availability of training data could lead to overfitting. In this work, we evaluated different types of PEFT methods on pre-trained vision transformers relative to typical training approaches, such as full fine-tuning and training from scratch. We used a transformer-based masked autoencoder (MAE) framework, to pretrain a vision encoder on T1- weighted (T1-w) brain MRIs. The pretrained vision transformers were then fine-tuned using different PEFT methods that reduced the trainable model parameters to as few as 0.04% of the original model size. Our study shows that: 1. PEFT methods were competitive with or outperformed the reference full fine-tuning approach and outperformed training from scratch, with only a fraction of the trainable parameters; 2. PEFT methods with a 32% reduction in model size boosted Alzheimers disease (AD) classification by 3% relative to full fine-tuning and 11% relative to a 3D CNN, with only 258 training scans; and 3. PEFT methods performed well on diverse neuroimaging tasks including AD and Parkinsons disease (PD) classification, and "brain-age" prediction based on T1-w MRI datasets - a standard benchmark for deep learning models in neuroimaging; 4. smaller model sizes were competitive with larger models in test performance. Our results show the value of adapting foundation models to neuroimaging tasks efficiently and effectively in contrast to training stand- alone special purpose models.

neuroscience↗

Evaluating Synthetic Diffusion MRI Maps created with Diffusion Denoising Probabilistic Models

Generative AI models, such as Stable Diffusion, DALL-E, and MidJourney, have recently gained widespread attention as they can generate high-quality synthetic images by learning the distribution of complex, high-dimensional image data. These models are now being adapted for medical and neuroimaging data, where AI-based tasks such as diagnostic classification and predictive modeling typically use deep learning methods, such as convolutional neural networks (CNNs) and vision transformers (ViTs), with interpretability enhancements. In our study, we trained latent diffusion models (LDM) and denoising diffusion probabilistic models (DDPM) specifically to generate synthetic diffusion tensor imaging (DTI) maps. We developed models that generate synthetic DTI maps of mean diffusivity by training on real 3D DTI scans, and evaluating realism and diversity of the synthetic data using maximum mean discrepancy (MMD) and multi-scale structural similarity index (MS-SSIM). We also assess the performance of a 3D CNN-based sex classifier, by training on combinations of real and synthetic DTIs, to check if performance improved when adding the synthetic scans during training, as a form of data augmentation. Our approach efficiently produces realistic and diverse synthetic data, potentially helping to create interpretable AI-driven maps for neuroscience research and clinical diagnostics.

neuroscience↗

Comparison of Explainable AI Models for MRI-based Alzheimer's Disease Classification

Deep learning models based on convolutional neural networks (CNNs) have been used to classify Alzheimers disease or infer dementia severity from 3D T1-weighted brain MRI scans. Here, we examine the value of adding occlusion sensitivity analysis (OSA) and gradient-weighted class activation mapping (Grad-CAM) to these models to make the results more interpretable. Much research in this area focuses on specific datasets such as the Alzheimers Disease Neuroimaging Initiative (ADNI) or National Alzheimers Coordinating Center (NACC), which assess people of North American, predominantly European ancestry, so we examine how well models trained on these data generalize to a new population dataset from India (NIMHANS cohort). We also evaluate the benefit of using a combined dataset to train the CNN models. Our experiments show feature localization consistent with knowledge of AD from other methods. OSA and Grad-CAM resolve features at different scales to help interpret diagnostic inferences made by CNNs.

neuroscience↗