Search bioRxivSearch

Biology subjects

Schmidt, K.

Publications and source records attributed to Schmidt, K..

4 recordsLinked to original sources

Brain-Score: Which Artificial Neural Network for Object Recognition is most Brain-Like?

The internal representations of early deep artificial neural networks (ANNs) were found to be remarkably similar to the internal neural representations measured experimentally in the primate brain. Here we ask, as deep ANNs have continued to evolve, are they becoming more or less brain-like? ANNs that are most functionally similar to the brain will contain mechanisms that are most like those used by the brain. We therefore developed Brain-Score - a composite of multiple neural and behavioral benchmarks that score any ANN on how similar it is to the brains mechanisms for core object recognition - and we deployed it to evaluate a wide range of state-of-the-art deep ANNs. Using this scoring system, we here report that: (1) DenseNet-169, CORnet-S and ResNet-101 are the most brain-like ANNs. (2) There remains considerable variability in neural and behavioral responses that is not predicted by any ANN, suggesting that no ANN model has yet captured all the relevant mechanisms. (3) Extending prior work, we found that gains in ANN ImageNet performance led to gains on Brain-Score. However, correlation weakened at [≥] 70% top-1 ImageNet performance, suggesting that additional guidance from neuroscience is needed to make further advances in capturing brain mechanisms. (4) We uncovered smaller (i.e. less complex) ANNs that are more brain-like than many of the best-performing ImageNet models, which suggests the opportunity to simplify ANNs to better understand the ventral stream. The scoring system used here is far from complete. However, we propose that evaluating and tracking model-benchmark correspondences through a Brain-Score that is regularly updated with new brain data is an exciting opportunity: experimental benchmarks can be used to guide machine network evolution, and machine networks are mechanistic hypotheses of the brains network and thus drive next experiments. To facilitate both of these, we release Brain-Score.org: a platform that hosts the neural and behavioral benchmarks, where ANNs for visual processing can be submitted to receive a Brain-Score and their rank relative to other models, and where new experimental data can be naturally incorporated.

neuroscience

Large-scale, high-resolution comparison of the core visual object recognition behavior of humans, monkeys, and state-of-the-art deep artificial neural networks

Primates--including humans--can typically recognize objects in visual images at a glance even in the face of naturally occurring identity-preserving image transformations (e.g. changes in viewpoint). A primary neuroscience goal is to uncover neuron-level mechanistic models that quantitatively explain this behavior by predicting primate performance for each and every image. Here, we applied this stringent behavioral prediction test to the leading mechanistic models of primate vision (specifically, deep, convolutional, artificial neural networks; ANNs) by directly comparing their behavioral signatures against those of humans and rhesus macaque monkeys. Using high-throughput data collection systems for human and monkey psychophysics, we collected over one million behavioral trials for 2400 images over 276 binary object discrimination tasks. Consistent with previous work, we observed that state-of-the-art deep, feed-forward convolutional ANNs trained for visual categorization (termed DCNNIC models) accurately predicted primate patterns of object-level confusion. However, when we examined behavioral performance for individual images within each object discrimination task, we found that all tested DCNNIC models were significantly non-predictive of primate performance, and that this prediction failure was not accounted for by simple image attributes, nor rescued by simple model modifications. These results show that current DCNNIC models cannot account for the image-level behavioral patterns of primates, and that new ANN models are needed to more precisely capture the neural mechanisms underlying primate object vision. To this end, large-scale, high-resolution primate behavioral benchmarks--such as those obtained here--could serve as direct guides for discovering such models.\n\nSIGNIFICANCE STATEMENTRecently, specific feed-forward deep convolutional artificial neural networks (ANNs) models have dramatically advanced our quantitative understanding of the neural mechanisms underlying primate core object recognition. In this work, we tested the limits of those ANNs by systematically comparing the behavioral responses of these models with the behavioral responses of humans and monkeys, at the resolution of individual images. Using these high-resolution metrics, we found that all tested ANN models significantly diverged from primate behavior. Going forward, these high-resolution, large-scale primate behavioral benchmarks could serve as direct guides for discovering better ANN models of the primate visual system.

neuroscience

Strong positive biodiversity-productivity relationships in a subtropical forest experiment

Forest ecosystems contribute substantially to global terrestrial primary productivity and climate regulation, but, in contrast to grasslands, experimental evidence for a positive biodiversity-productivity relationship in highly diverse forests is still lacking1. Here, we provide such evidence from a large forest biodiversity experiment with a novel design2 in subtropical China. Productivity (stand-level tree basal area, aboveground volume and carbon and their annual increment) increased linearly with the logarithm of tree species richness. Additive partitioning3 showed that increasing positive complementarity effects combined with weakening negative selection effects caused a strengthening of the relationship over time. In 2-species mixed stands, complementary effects increased with functional distance and selection effects with vertical crown dissimilarity between species. Understorey shrubs reduced stand-level tree productivity, but this effect of competition was attenuated by shrub species richness, indicating that a diverse understorey may facilitate overall ecosystem functioning. Identical biodiversity-productivity relationships were found in plots of different size, suggesting that extrapolation to larger scales is possible. Our results highlight the potential of multi-species afforestation strategies to simultaneously contribute to mitigation of climate change and biodiversity restoration.

ecology

Targeted re-sequencing of coding DNA sequences for SNP discovery in non-model species

Hybridization capture coupled with high-throughput sequencing can be used to gain information about nuclear sequence variation at hundreds to thousands of loci. A cross-species approach makes use of molecular data of one species to enrich target loci in other (related) species. This is particularly valuable for non-model organisms, for which often no a priori knowledge exists regarding these loci. Here, we have adopted cross-species capture to obtain data for 809 nuclear coding DNA sequences (CDS) in a non-model organism, the Eurasian lynx Lynx lynx, using baits designed with the help of the published genome of a related model organism (the domestic cat Felis catus). In this manner, we were able to survey intraspecific variation at hundreds of nuclear loci across the European range of L. lynx. A large set of bi-allelic candidate SNPs was then tested in a high throughput SNP-genotyping platform (Fluidigm), which we reduced to a final 96 SNP-panel based on assay performance and reliability; validation was carried out with additional samples not included in the SNP discovery phase. The 96 SNP-panel developed from CDS performed very successfully in the identification of individuals and in population genetic structure inference (incl. the assignment of individuals to their source population). In keeping with recent studies, our results show that genic SNPs can be valuable for genetic monitoring of wildlife species.

genetics