This study focuses on feature selection in paralinguistic analysis and presents recently developed supervised and unsupervised methods for feature subset selection and feature ranking. Using the standard k-nearest-neighbors (kNN) rule as the classification algorithm, the feature selection methods are evaluated individually and in different combinations in seven paralinguistic speaker trait clas...

If speech analysis is to detect a speaker’s emotional state, it needs to derive information from both linguistic information, i.e., the qualitative targets that the speaker has attained (or approximated), conforming to the rules of language; and paralinguistic information, i.e., allowed variations in the way that qualitative linguistic targets are realised. It also needs an appropriate represen...

Paralinguistic analysis is increasingly turning into a mainstream topic in speech and language processing. This article aims to provide a broad overview of the constantly growing field by defining the field, introducing typical applications, presenting exemplary resources, and sharing a unified view of the chain of processing. It then presents the first broader Paralinguistic Challenge organise...

Paralinguistic speech processing is important in addressing many issues, such as sentiment and neurocognitive disorder analyses. Recently, Transformer has achieved remarkable success the natural language field demonstrated its adaptation to speech. However, previous works on have not incorporated properties of speech, leaving full potential unexplored. In this paper, we consider characteristics...

Expressive interjection (EI) is defined as non-lexical speech sound which indicates the speaker’s cognitive/affective state changes. It is a type of vocal affect burst, i.e., brief and sudden nonverbal expressions that are produced spontaneously and unconsciously. Although EI as a social signal is assumed to play an important part in speech communication, very little is known about its linguist...

The following is concerned with the linguistic components of expressive speech synthesis. It tries to fulfil the role that Huckvale (2002) assigns to the linguist in speech science for speech synthesis. Linguists find models and parameters for the description of language. The semiotic foundations for the study of expressive herein have to be modelled upon a concept that every sign has got a con...

Head motions naturally occur in synchrony with speech and may carry paralinguistic information, such as intentions, attitudes and emotions, in dialogue communication. With the aim of verifying the relationship between head motions and the linguistic and paralinguistic functions carried by speech, analyses were conducted on motion-captured data of several speakers during natural dialogues. The a...

Paralinguistic cues in children’s speech convey the child’s affective state and can serve as important markers for the early detection of autism spectrum disorder (ASD). In this paper, we detect paralinguistic events, such as laughter and fussing/crying, along with toddlers’ speech from the Multi-modal Dyadic Behavior Dataset (MMDB). We use both spectral and prosodic acoustic features selected ...