Search bioRxiv⌕ Search
Home/Archive/bioRxiv

bioRxiv · 10.1101/038133

DAVID: An open-source platform for real-time emotional speech transformation. With 25 applications in the behavioral sciences

Laura Rachman·Marco Liuni·Pablo Arias·Andreas Lind·Petter Johansson·Lars Hall·Daniel Richardson·Katsumi Watanabe·Stephanie Dubal·Jean-Julien Aucouturier
View original source ↗Export metadata ↓

Abstract

We present an open-source software platform that transforms the emotions expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real-time (with less than 20-millisecond latency), using live input from a microphone. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments showing that transformed emotions are recognized at above-chance levels in the French, English, Swedish and Japanese languages, with a naturalness comparable to natural speech. Then, we provide a list of twenty-five experimental ideas applying this new tool to important topics in the behavioral sciences.

Explore related subjects

Animal Behavior and CognitionPreprint

Keep this discovery

BibTeXRIS

Laura Rachman, Marco Liuni, Pablo Arias, Andreas Lind, Petter Johansson, Lars Hall, Daniel Richardson, Katsumi Watanabe, Stephanie Dubal, Jean-Julien Aucouturier. 2016-01-28. DAVID: An open-source platform for real-time emotional speech transformation. With 25 applications in the behavioral sciences. https://doi.org/10.1101/038133

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2016

FUNCTIONAL MRI IN AWAKE DOGS PREDICTS SUITABILITY FOR ASSISTANCE WORK

The overall goal of this work was to measure the efficacy of fMRI for predicting whether a dog would be a successful service dog. The training and imaging were performed in 50 dogs entering advanced training at 17-21 months of age. FMRI responses were measured while each dog observed hand signals indicating either reward or no reward and given by both a familiar handler and a stranger. 49 dogs successfully completed fMRI training and scanning. Of these, 33 eventually completed service training and were matched with a person, while 10 were released for behavioral reasons. Using anatomically defined regions-of-interest in the ventral caudate, amygdala, and visual cortex, we developed a classifier based on the dogs' outcomes. We found that responses in the stranger condition were sufficient to develop an accurate brain-based classifier. On all data, the classifier had a positive predictive value of 96% with 10% false positives. The area under the receiver operating characteristic curve was 0.90 (0.79 with 4-fold cross-validation, P=0.02), indicating a significant diagnostic capability. Within the stranger condition, the differential response to [reward - no reward] in ventral caudate was positively correlated with a successful outcome, while the differential response in the amygdala was negatively correlated to outcome. These results show that successful service dogs transfer knowledge to strangers as indexed by ventral caudate activity without excessive arousal as measured in the amygdala.

Animal Behavior and Cognition↗
bioRxiv2016

Automatic Head Tracking of The Common Marmoset.

New technologies for manipulating and recording the nervous system allow us to perform unprecedented experiments. However, the influence of our experimental manipulations on psychological processes must be inferred from their effects on behavior. Today, quantifying behavior has become the bottleneck for large-scale, high-throughput, experiments. The method presented here addresses this issue by using deep learning algorithms for video-based animal tracking. Here we describe a reliable automatic method for tracking head position and orientation from simple video recordings of the common marmoset (Callithrix jacchus). This method for measuring marmoset behavior allows for the estimation of gaze within foveal error, and can easily be adapted to a wide variety of similar tasks in biomedical research. In particular, the method has great potential for the simultaneous tracking of multiple marmosets to quantify social behaviors.

Animal Behavior and Cognition↗
bioRxiv2016

Behavior of Caenorhabditis elegans in a nicotine gradient modulated by food

Nicotine decreases food intake, and smokers often report that they smoke to control their weight. To see whether similar phenomena could be observed in the model organism Caenorhabditis elegans, we challenged drug-naive nematodes with a chronic low (0.01 mM) and high (1 mM) nicotine concentration for 55 h (from hatching to adulthood). After that, we recorded changes in their behavior in a nicotine gradient, where they could choose a desired nicotine concentration. By using a combination of behavioral and morphometric methods, we found that both nicotine and food modulate worm behavior. In the presence of food the nematodes adapted to the low nicotine concentration, when placed in the gradient, chose a similar nicotine concentration like C. elegans adapted to the high nicotine concentration. However, in the absence of food, the nematodes adapted to the low nicotine concentration, when placed in the gradient of this alkaloid, chose a similar nicotine concentration like naive worms. The nematodes growing up in the presence of high concentrations of nicotine had a statistically smaller body size, compared to the control condition, and the presence of food did not cause any enhanced slowing movement. These results provide a platform for more detailed molecular and cellular studies of nicotine addiction and food intake in this model organism.

Animal Behavior and Cognition↗