A dependency-free, streamable format and cross-language toolkit for scalable LC-MS feature detection: reading only what you need

Abstract

Mass spectrometry generates data faster than it can be read, and the exchange standard, mzML, is text-based and must be parsed in full before any spectrum is accessible. Binary alternatives are smaller but depend on storage engines such as HDF5, so access is dictated by the engine, not the file. We present Ionic (.ion), an open-source, compact, streamable binary format, and Quant{middle dot}ion, a processing toolkit built on the former. Ionic stores spectra, chromatograms and metadata as independently compressed, indexed blocks, so a reader retrieves only the bytes it needs, even inside a web browser, and converts losslessly to and from mzML. Ionic was smaller than compressed mzMLb on every acquisition type tested, and extracting one compound took under 40 ms, 35 to 90 times faster than an mzML reader. Quant{middle dot}ion exposes one core to R, Python, and JavaScript with identical results, and recovered 97% of true features on a ground-truth benchmark.