Search bioRxiv⌕ Search

Biology subjects

Dorsi, J.

Publications and source records attributed to Dorsi, J..

3 recordsLinked to original sources

Associations Between Shape Iconicity Ratings and Speech Acoustics: Comparing Real Words and Pseudowords

Iconicity in spoken language refers to the mapping of speech sounds to meaning. For example, the pseudoword "bouba" is judged to sound rounded, whereas the pseudoword "kiki" is judged to sound pointed (Ramachandran & Hubbard, 2001). Recent work has found systematic relationships between speech acoustics and iconicity ratings in various meaning domains, including shape. To control for confounding by semantic knowledge, much research on iconicity relies on pseudowords. However, the role of iconicity in conveying the meanings of real words is still poorly understood. Here, we compared the relationship between speech acoustics and shape iconicity ratings for both pseudowords and real words. In this experiment, participants rated real words and pseudowords for how rounded or pointed they sounded. We compared the relationship between 12 acoustic parameters and the rounded/pointed ratings for both words and pseudowords. We found that the correlations between these acoustic parameters and the ratings were similar for real words and pseudowords, providing key evidence that iconicity of real words is linked to speech acoustics.

neuroscience↗

Iconic Sound-Shape Correspondences in Aphasia

PurposeTo examine speech iconicity for shape in aphasia, we compared iconicity ratings from people with aphasia to those from neurologically intact individuals and evaluated how iconicity relates to phonological and semantic processing profiles in aphasia. MethodEleven people with aphasia and 11 age- and gender-matched neurologically intact participants rated how rounded or pointed 50 auditory pseudowords sounded using a 5-point scale. Ratings from participants with aphasia were compared to predicted iconicity ratings derived from reference ratings from prior work and to ratings from neurologically intact participants. For each participant with aphasia, correlations between individual ratings and predicted ratings were related to measures of phonological and semantic processing. ResultsRatings from people with aphasia were significantly correlated with both the predicted ratings and the ratings from neurologically intact participants. The strength of the correlation between individual ratings and predicted ratings did not differ significantly between groups, although there was a trend toward weaker correlations in the aphasia group. There were indications that greater language impairment was associated with greater disruption of iconicity ratings; in particular, deficits in phonological segmentation and semantic processing were associated with reduced sensitivity to shape iconicity. ConclusionThese findings suggest that sensitivity to shape iconicity is preserved in individuals with aphasia to varying degrees. The specific nature of language impairment appears to play an important role in determining iconicity processing in aphasia.

neuroscience↗

Acoustic parameter combinations underlying mapping of auditory pseudoword sounds to multiple domains of meaning: a machine learning approach

In spoken language, iconicity, referring to the resemblance between the sound structure of words and their meaning, is often studied using pseudowords. Previously, we showed that representational dissimilarity matrices (RDMs) of the shape ratings of pseudowords correlated significantly with RDMs of acoustic parameters reflecting spectro-temporal variations; the ratings also correlated significantly with voice quality parameters. Here, we examined how perceptual ratings relate to these parameters of pseudowords across eight meaning domains. We largely replicated our previous findings for shape, while observing different patterns for other domains. Using a k-nearest-neighbor (KNN) machine-learning algorithm, we compared 4095 combinations of twelve acoustic parameters (3 spectro-temporal and 9 characterizing vocal quality) to determine the optimal combination associated with iconicity ratings in each domain. We found that iconic mappings were linked to domain-specific combinations of acoustic parameters. One spectro-temporal parameter, the fast Fourier transform, contributed to all domains, indicating the importance of time-varying spectral properties for iconicity judgments. We applied the KNN approach to generate shape ratings for 160 real words. These generated ratings strongly correlated with perceptual ratings of real words, indicating the value of the KNN approach to assess iconic mapping in natural languages. Our findings support the relevance of iconicity to language.

neuroscience↗