Search bioRxiv⌕ Search

Biology subjects

Jeon, Y.-N.

Publications and source records attributed to Jeon, Y.-N..

3 recordsLinked to original sources

Efficient task generalization and humanlike face perception in models that learn to discriminate face geometry

Artificial deep neural networks (DNNs) can excel at face recognition from 2D photographs where both shape and appearance cues abound; however, DNNs have rarely been challenged to recognize faces strictly based on face geometry. Here, we show that DNNs, even those fine-tuned on face photographs, had almost no generalization performance to a new geometry-based face task, while in the opposite direction, networks fine-tuned only on geometrically defined, textureless faces readily generalized to textured faces. To learn geometry in a more practical setting with colored and textured faces, we trained discrimination on face emotion in addition to face identity, which resulted in less texture bias and generalized well across face tasks. Learning in this way from just four individuals and their expressions generalized to unseen individuals, even exceeding standard models which are trained on classifying hundreds of face identities. Compared to standard models, emotion and identity trained models developed more humanlike errors in the identities or emotions that they confused. This novel method learns in a humanlike manner using only a few individuals but enriched with expressions that widely vary face geometry - similar to early human experience during child-parent interactions. Thus, this bioinspired work has broad implications for how moving toward humanlike learning of geometry in artificial vision can be both highly sample efficient and highly performing.

neuroscience↗

Humans and marmosets share similar face recognition signatures in shape-based visual face discrimination behavior

Our ability to identify faces is thought to depend on high-level visual processing in the brain. Nonetheless, studies of face recognition have generally relied on 2D face photographs where low-level strategies relying on texture and appearance cues can be employed to adequately support high face identification performance. Here, we designed a fine face discrimination task under 3D pose and lighting variation that was purely based on shape, a task which challenged state-of-the-art artificial vision systems compared to object recognition tasks. In contrast, humans performed this shape based face task at comparable levels to their object recognition performance. We then tested one of the smallest simian primates on this human-level, machine-difficult visual task, the common marmoset - a small, New World monkey. Marmosets successfully discriminated between face identities across 3D viewing conditions based purely on face shape. Their face recognition performance was on par with their object recognition performance and exhibited face-specific behavioral signatures similar to humans, including lower performance for inverted faces, faces lit from below, and contrast reversed faces. These results demonstrate that a high-level visual behavior, invariant face recognition based purely on geometry and not additional texture and appearance cues, is shared across simian primates from among the smallest to the most advanced, consistent with the presence of common underlying high-level visual brain areas across simian primates.

neuroscience↗

Conserved core visual object recognition across simian primates: Marmoset image-by-image behavior mirrors that of humans and macaques

Bigger brains are thought to support richer abilities, including perceptual abilities. But bigger brains are typically organized differently (e.g., with more cortical areas). Thus, the extent to which a neural systems size versus organization underlies complex abilities remains unclear. The marmoset monkey is evolutionarily peculiar: it has a small brain, yet many cortical areas. We used this natural experiment to test organization as source of high-level visual abilities independent of size, via large-scale psychophysics comparing marmosets to different species on identical tasks. Marmosets far out--performed rats--a marmoset-sized rodent--on a simple visual recognition task. On another visual task, which is difficult for both humans and machines, marmosets achieved high performance. Strikingly, their image-by-image behavior revealed that they did so in a manner highly similar to humans--marmosets were nearly as human-like as were macaques. These results suggest a key role for brain organization--not simply size--in the evolution of sophisticated abilities.

neuroscience↗