Biology subjects

Kuperberg, G. R.

Publications and source records attributed to Kuperberg, G. R..

4 recordsLinked to original sources

bioRxiv2024

GPT-3 reveals selective insensitivity to global vs. local linguistic context in speech produced by treatment-naive patients with positive thought disorder

BackgroundEarly psychopathologists proposed that certain features of positive thought disorder, the disorganized language output produced by some people with schizophrenia, suggest an insensitivity to global, relative to local, discourse context. This idea has received support from carefully controlled psycholinguistic studies in language comprehension. In language production, researchers have so far remained reliant on subjective qualitative rating scales to assess and understand speech disorganization. Now, however, recent advances in large language models mean that it is possible to quantify sensitivity to global and local context objectively by probing lexical probability (the predictability of a word given its preceding context) during natural language production. MethodsFor each word in speech produced by 60 first-episode psychosis patients and 35 healthy, demographically-matched controls, we extracted lexical probabilities from GPT-3 based on contexts that ranged from very local-- a single preceding word: P(Wn | Wn-1)--to global-- up to 50 preceding words: P(Wn|Wn-50, Wn-49, ..., Wn-1). ResultsWe show, for the first time, that disorganized speech is characterized by disproportionate insensitivity to global, versus local, linguistic context. Critically, this global-versus-local insensitivity selectively predicted clinical ratings of positive thought disorder, above and beyond overall symptom severity. There was no evidence of a relationship with negative thought disorder (impoverishment). ConclusionsWe provide an automated, interpretable measure that can potentially be used to quantify speech disorganization in schizophrenia. Our findings directly link the clinical phenomenology of thought disorder to neurocognitive constructs that are grounded in psycholinguistic theory and neurobiology.

neuroscience↗

bioRxiv2019

Neural evidence for the prediction of animacy features during language comprehension: Evidence from MEG and EEG Representational Similarity Analysis

It has been proposed that people can generate probabilistic predictions at multiple levels of representation during language comprehension. We used Magnetoencephalography (MEG) and Electroencephalography (EEG), in combination with Representational Similarity Analysis (RSA), to seek neural evidence for the prediction of animacy features. In two studies, MEG and EEG activity was measured as human participants (both sexes) read three-sentence scenarios. Verbs in the final sentences constrained for either animate or inanimate semantic features of upcoming nouns, and the broader discourse context constrained for either a specific noun or for multiple nouns belonging to the same animacy category. We quantified the similarity between spatial patterns of brain activity following the verbs until just before the presentation of the nouns. The MEG and EEG datasets revealed converging evidence that the similarity between spatial patterns of neural activity following animate constraining verbs was greater than following inanimate constraining verbs. This effect could not be explained by lexical-semantic processing of the verbs themselves. We therefore suggest that it reflected the inherent difference in the semantic similarity structure of the predicted animate and inanimate nouns. Moreover, the effect was present regardless of whether a specific word could be predicted, providing strong evidence for the prediction of coarse-grained semantic features that goes beyond the prediction of individual words. Significance statementLanguage inputs unfold very quickly during real-time communication. By predicting ahead we can give our brains a "head-start", so that language comprehension is faster and more efficient. While most contexts do not constrain strongly for a specific word, they do allow us to predict some upcoming information. For example, following the context, "they cautioned the...", we can predict that the next word will be animate rather than inanimate (we can caution a person, but not an object). Here we used EEG and MEG techniques to show that the brain is able to use these contextual constraints to predict the animacy of upcoming words during sentence comprehension, and that these predictions are associated with specific spatial patterns of neural activity.

neuroscience↗

bioRxiv2017

Left-Lateralized Contributions of Saccades to Cortical Activity during a One-Back Word Recognition Task

Saccadic eye movements are an inherent component of natural reading, yet their contribution to information processing at subsequent fixation remains elusive. Here we use anatomically-constrained magnetoencephalography (MEG) to examine cortical activity following saccades as healthy human subjects engaged in a one-back word recognition task. This activity was compared with activity following external visual stimulation that mimicked saccades. A combination of procedures were employed to eliminate saccadic ocular artifacts from the MEG signal. Both saccades and saccade-like external visual stimulation produced early-latency responses beginning ~70 ms after onset in occipital cortex and spreading through the ventral and dorsal visual streams to temporal, parietal and frontal cortices. Robust differential activity following the onset of saccades versus similar external visual stimulation emerged during 150-350 ms in a left-lateralized cortical network. This network included (i) left lateral occipitotemporal and nearby inferotemporal cortex, (ii) left posterior Sylvian fissure and nearby multimodal cortex, and (iii) medial parietooccipital, posterior cingulate and retrosplenial cortices. Moreover, this left-lateralized network colocalized with word repetition priming effects. Together, results suggest that central saccadic mechanisms influence a left-lateralized language network in occipitotemporal and temporal cortex above and beyond saccadic influences at preceding stages of information processing during visual word recognition.

neuroscience↗

bioRxiv2017

Prediction (Or Not) During Language Processing. A Commentary On Nieuwland et al. (2017) And Delong et al. (2005)

The extent to which language processing involves prediction of upcoming inputs remains a question of ongoing debate. One important data point comes from DeLong et al. (2005) who reported that an N400-like event-related potential correlated with a probabilistic index of upcoming input. This result is often cited as evidence for gradient probabilistic prediction of form and/or semantics, prior to the bottom-up input becoming available. However, a recent multi-lab study reports a failure to find these effects (Nieuwland et al., 2017). We review the evidence from both studies, including differences in the design and analysis approach between them. Building on over a decade of research on prediction since DeLong et al. (2005)s original study, we also begin to spell out the computational nature of predictive processes that one might expect to correlate with ERPs that are evoked by a functional element whose form is dependent on an upcoming predicted word. For paradigms with this type of design, we propose an index of anticipatory processing, Bayesian surprise, and apply it to the updating of semantic predictions. We motivate this index both theoretically and empirically. We show that, for studies of the type discussed here, Bayesian surprise can be closely approximated by another, more easily estimated information theoretic index, the surprisal (or Shannon information) of the input. We re-analyze the data from Nieuwland and colleagues using surprisal rather than raw probabilities as an index of prediction. We find that surprisal is gradiently correlated with the amplitude of the N400, even in the data shared by Nieuwland and colleagues. Taken together, our review suggests that the evidence from both studies is compatible with anticipatory semantic processing. We do, however, emphasize the need for future studies to further clarify the nature and degree of form prediction, as well as its neural signatures, during language comprehension.

neuroscience↗