A major limitation of 3D point cloud-based representations is that they often fail to capture an object’s functional features – a 3D model of a stapler does not specify where the stapler should be pressed. For many tools, successful manipulation requires that the robot detects the specific location that needs to be actuated (e.g., a trigger or a button) to turn on the tool. Yet, to date, virtua...

Searching for an object within a cluttered, continuously changing environment can be a very time-consuming process. The authors show that a simple auditory pip drastically decreases search times for a synchronized visual object that is normally very difficult to find. This effect occurs even though the pip contains no information on the location or identity of the visual object. The experiments...

This paper presents a successful application of deep learning for object recognition based on acoustic data. The shortcomings of previously employed approaches where handcrafted features describing the acoustic data are being used, include limiting the capability of the found representation to be widely applicable and facing the risk of capturing only insignificant characteristics for a task. I...

Auditory authoring is an essential component in the design of virtual environments and describes the process of assigning sounds and voices to objects within a virtual 3D scene. In a broader sense, auditory authoring also includes the definition of dependencies between objects and different object states, as well as timeand user-dependent interactions in dynamic environments. Our system unifies...

Auditory working memory for objects vs. features. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No ...

In press, Cognitive Science 2 Abstract The analysis of pure word deafness (PWD) suggests that speech perception, construed as the integration of acoustic information to yield representations that enter into the linguistic computational system, (i) is separable in a modular sense from other aspects of auditory cognition and (ii) is mediated by the posterior superior temporal cortex in both hemis...

The ventriloquism-effect describes an attracting influence of visual objects on perceived auditory directions. In the ventriloquist example the spectators will perceive the sound as coming from the mouth of the puppet as it’s lips make synchronous movements to the speech, although the ventriloquist speaks. When simulating directions in auditory displays the question comes up how the auditory di...

Predictive processing of information is essential for goal-directed behavior. We offer an account of auditory perception suggesting that representations of predictable patterns, or 'regularities', extracted from the incoming sounds serve as auditory perceptual objects. The auditory system continuously searches for regularities within the acoustic signal. Primitive regularities may be encoded by...

The role of early auditory processing may be to extract some elementary features from an acoustic mixture in order to organize the auditory scene. To accomplish this task, the central auditory system may rely on the fact that sensory objects are often composed of spectral edges, i.e., regions where the stimulus energy changes abruptly over frequency. The processing of acoustic stimuli may benef...

Numerous studies have investigated the spatial sensitivity of cat auditory cortical neurons, but possible dynamic properties of the spatial receptive fields have been largely ignored. Given the considerable amount of evidence that implicates the primary auditory field in the neural pathways responsible for the perception of sound source location, a logical extension to earlier observations of s...