Search bioRxiv⌕ Search

Biology subjects

Veeraraghavan, H.

Publications and source records attributed to Veeraraghavan, H..

5 recordsLinked to original sources

Artificial Intelligence Apps for Medical Image Analysis using pyCERR and Cancer Genomics Cloud

This work introduces a user-friendly, cloud-based software framework for conducting Artificial Intelligence (AI) analyses of medical images. The framework allows users to deploy AI-based workflows by customizing software and hardware dependencies. The components of our software framework include the Python-native Computational Environment for Radiological Research (pyCERR) platform for radiological image processing, Cancer Genomics Cloud (CGC) for accessing hardware resources and user management utilities for accessing images from data repositories and installing AI models and their dependencies. GNU-GPL copyright pyCERR was ported to Python from MATLAB-based CERR to enable researchers to organize, access, and transform metadata from high dimensional, multi-modal datasets to build cloud-compatible workflows for AI modeling in radiation therapy and medical image analysis. pyCERR provides an extensible data structure to accommodate metadata from commonly used medical imaging file formats and a viewer to allow for multi-modal visualization. Analysis modules are provided to facilitate cloud-compatible AI-based workflows for image segmentation, radiomics, DCE MRI analysis, radiotherapy dose-volume histogram-based features, and normal tissue complication and tumor control models for radiotherapy. Image processing utilities are provided to help train and infer convolutional neural network-based models for image segmentation, registration and transformation. The framework allows for round-trip analysis of imaging data, enabling users to apply AI models to their images on CGC and retrieve and review results on their local machine without requiring local installation of specialized software or GPU hardware. The deployed AI models can be accessed using APIs provided by CGC, enabling their use in a variety of programming languages. In summary, the presented framework facilitates end-to-end radiological image analysis and reproducible research, including pulling data from sources, training or inferring from an AI model, utilities for data management, visualization, and simplified access to image metadata.

bioinformatics↗

Technical Note: STRATIS: A Cloud-enabled Software Toolbox for Radiotherapy and Imaging Analysis

PurposeRecent advances in computational resources, including software libraries and hardware, have enabled the use of high-dimensional, multi-modal datasets to build Artificial Intelligence (AI) models and workflows for radiation therapy and image analysis. The purpose of Software Toolbox for RAdioTherapy and Imaging analysiS (STRATIS) is to provide cloud-enabled, easy-to-share software workflows to train and deploy AI models for transparency and multi-institutional collaboration. MethodSTRATIS leverages open source medical image informatics software for application-specific analysis. Jupyter notebooks for AI modeling workflows are provided with Python language as the base kernel. In addition to Python, workflows use software written in other languages, such as MATLAB, GNU-Octave, R, and C++, with the help of bridge libraries. The workflows can be run on a cloud platform, local workstation, or an institutional HPC cluster. Computational environments are provided in the form of publicly available docker images -and build scripts for local Anaconda environments. Utilities provided with STRATIS simplify bookkeeping of associations between imaging objects and allow chaining data processing operations defined via a setting file for AI models. ResultsWorkflows available on STRATIS can be broadly categorized into image segmentation, deformable image registration, and outcomes modeling for radiotherapy toxicity and tumor control using radiomics and dosimetry features. The STRATIS-forge GitHub organization https://www.github.com/stratis-forge hosts build-scripts for Docker and Anaconda as well as Jupyter notebooks for analysis workflows. The software for building environments and workflow notebooks has open source-GNU-GPL copyright, and AI models retain the copyright chosen by their original developers. ConclusionSTRATIS enables researchers to deploy and share AI modeling workflows for radiotherapy and image analysis. STRATIS is publicly available on Terra.bios FireCloud platform with a pre-deployed computational environment and on GitHub organization for users pursuing local deployment.

bioinformatics↗

Portable framework to deploy deep learning segmentation models for medical images

PurposeThis work presents a framework for deployment of deep learning image segmentation models for medical images across different operating systems and programming languages. MethodsComputational Environment for Radiological Research (CERR) platform was extended for deploying deep learning-based segmentation models to leverage CERRs existing functionality for radiological data import, transformation, management, and visualization. The framework is compatible with MATLAB as well as GNU Octave and Python for license-free use. Pre and post processing configurations including parameters for pre-processing images, population of channels, and post-processing segmentations was standardized using JSON format. CPU and GPU implementations of pre-trained deep learning segmentation models were packaged using Singularity containers for use in Linux and Conda environment archives for Windows, macOS and Linux operating systems. The framework accepts images in various formats including DICOM and CERRs planC and outputs segmentation in various formats including DICOM RTSTRUCT and planC objects. The ability to access the results readily in planC format enables visualization as well as radiomics and dosimetric analysis. The framework can be readily deployed in clinical software such as MIM via their extensions. ResultsThe open-source, GPL copyrighted framework developed in this work has been successfully used to deploy Deep Learning based segmentation models for five in-house developed and published models. These models span various treatment sites (H&N, Lung and Prostate) and modalities (CT, MR). Documentation for their usage and demo workflow is provided at https://github.com/cerr/CERR/wiki/Auto-Segmentation-models. The framework has also been used in clinical workflow for segmenting images for treatment planning and for segmenting publicly available large datasets for outcomes studies. ConclusionsThis work presented a comprehensive, open-source framework for deploying deep learning-based medical image segmentation models. The framework was used to translate the developed models to clinic as well as reproducible and consistent image segmentation across institutions, facilitating multi-institutional outcomes modeling studies.

bioinformatics↗

Library of model implementations for sharing deep-learning image segmentation and outcomes models

An open-source library of implementations for deep-learning based image segmentation and outcomes models is presented in this work. As oncology treatment planning becomes increasingly driven by automation, such a library of model implementations is crucial to (i) validate existing models on datasets collected at different institutions, (ii) automate segmentation, (iii) create ensembles for improving performance and (iv) incorporate validated models in the clinical workflow. The library was developed with Computational Environment for Radiological Research (CERR) software platform. CERR is a natural choice to centralize model implementations due to its comprehensiveness, popularity, and ease of use. CERR provides well-validated feature extraction for radiotherapy dosimetry and radiomics with fine control over the calculation settings. This allows users to select the appropriate feature calculation used in the model derivation. Models for automatic image segmentation are distributed via Singularity containers, with seamless i/o to and from CERR. Singularity containers allow for segmentation models to be deployed with a variety of scientific computing architectures. Deployment of models is driven by JSON configuration file, making it convenient to plug-in models. Models from the library can be called programmatically for batch evaluation. The library includes implementations for popular radiotherapy models outlined in the Quantitative Analysis of Normal Tissue Effects in the Clinic effort and recently published literature. Radiomics models include features from Image Biomarker Standardization features found to be important across multiple sites and image modalities. Deep learning-based image segmentation models include state of the art networks such as Deeplab and other problem-specific architectures. The library is distributed as GNU-copyrighted software at https://www.github.com/cerr/CERR.

bioinformatics↗

Computed Tomography Measures of Inter-site tumor Heterogeneity for Classifying Outcomes in High-Grade Serous Ovarian Carcinoma: a Retrospective Study

AbstractO_ST_ABSBackgroundC_ST_ABSHigh grade serous ovarian carcinoma shows marked intra-tumoral heterogeneity which is associated with decreased survival and resistance to platinum-based chemotherapy. Pre-treatment quantification of spatial tumor heterogeneity by multiple tissue sampling is not clinically feasible. Using standard-of-care CT imaging to non-invasively quantify heterogeneity could have high clinical utility and would be highly cost-effective. Texture analysis measures local variations in computed tomography (CT) image intensity. Haralick texture methods are typically used to capture the heterogeneity of entire lesions; however, this neglects the possible presence of texture habitats within the lesion, and the differences between metastatic sites. The primary aim of this study was to develop texture analysis of intra-site and inter-site spatial heterogeneity from standard-of-care CT images and to correlate these measures with clinical and genomic features in patients with HGSOC. Methods and findingsWe analyzed the data from a retrospective cohort of 84 patients with HGSOC consisting of 46 patients from Memorial Sloan Kettering Cancer Center (MSKCC) and 38 non-MSKCC cases selected from The Cancer Imaging Archive (TCIA). Inclusion criteria consisted of FIGO stage II-IV HGSOC, attempted primary cytoreductive surgery, intravenous contrast-enhanced CT of abdomen and pelvis performed prior to surgery and availability of molecular tumor data analysed as per the Cancer Genome Atlas (TCGA) Research Network ovarian cancer project. Manual segmentation and image analysis was performed on 463 metastatic tumor sites from 84 patients. In the MSKCC cohort the median number of tumor sites was 7 (interquartile range 5-9) and 4 (interquartile range 3-4) in the TCIA patients. Sub-regions were produced within each tumor site by grouping voxels with similar Haralick texture using the Kernel K-means method. We derived statistical measures of intra- and inter-site tumor heterogeneity (IISTH) including cluster sites entropy (cSE), cluster sites standard deviation (cluDev) and cluster sites dissimilarity (cluDiss) from sub-regions identified within and between individual tumor sites. Unsupervised clustering was used to group patient IISTH measures into low, medium, high, and ultra-high heterogeneity clusters from each cohort. The IISTH measure cluDiss was an independent predictor of progression-free survival (PFS) in multivariable analysis in both datasets (MSKCC hazard ratio [HR] 1.04, 95% CI 1.01-1.06, P = 0.002; TCIA HR 1.05, 95% CI 1.00-1.10, P = 0.049). Low and medium IISTH clusters were associated with longer PFS in multivariable analysis (MSKCC HR 2.94, 90% CI 1.29-6.70, P = 0.009, TCIA HR 5.94, 95% CI 1.05-33.6, P = 0.044). IISTH measures were robust to differences in the CT imaging systems. Average Haralick textures contrast (TCIA HR 1.08, 95% CI 1.01-1.10, P = 0.019) and homogeneity (TCIA HR 1.09, 95% CI 1.02-1.16, P = 0.008) were associated with PFS in mutivariate analysis only in the TCIA dataset. All other average Haralick textures and total tumor volume were not associated with PFS in either dataset. ConclusionsTexture measures of intra- and inter-site tumor heterogeneity from standard of care CT images are correlated with shorter PFS in HGSOC patients. These quantitative methods are independent of the CT imaging system and can thus be applied in clinical practice. The methodology proposed here enables the non-invasive quantification of intra-tumoral heterogeneity and disease stratification for future experimental medicine studies and clinical trials, particularly in cases where total tumour volume and averaged textures have low predictive power. Author summaryO_ST_ABSWhy was this study done?C_ST_ABSO_LITumor heterogeneity is a feature of many solid malignancies including ovarian cancer. C_LIO_LIRecent genomic research suggests that intra-site tumor heterogeneity (heterogeneity within a single tumor site) and inter-site tumor heterogeneity (heterogeneity between different metastatic sites in the same patient) correlate with clinical outcome in HGSOC. C_LI What did the researchers do and find?O_LIWe developed quantitative and non-invasive image-analysis based measures for predicting outcome in HGSOC patients by combining image-based information from within and between multiple tumor sites. C_LIO_LIUsing datasets from two sources, we demonstrate that these image-based tumor heterogeneity measures predict progression free survival in patients with HGSOC. C_LI What do these findings mean?O_LINon-invasive measures of CT image heterogeneity may predict outcomes in HGSOC patients. C_LIO_LIWider application of these CT image heterogeneity measures could prove useful for stratifying patients to different therapies given that total tumour volume and averaged textures have low predictive power. C_LI

bioinformatics↗