Before: Unimodal Linguistics, After: Multimodal Linguistics. A Parallel Architecture Account of a Multimodal Construction
نویسندگان
چکیده
Abstract This paper adopts a construction-grammar approach to multimodal meaning. We provide detailed analysis of the Before-After -construction used frequently in advertisements, cartoons and Internet memes. demonstrate that parts its generic ‘caused-change’ meaning is compositional, rendered independently from what overtly expressed by concrete instances pattern. The latter hence build on an abstract construction whose form elements are paired idiosyncratically with meaning, just like linguistic constructions proper. show non-standard Before-After-construction represent deviations based systematized standard Before-After-construction. Finally, we argue belongs broader inheritance hierarchy two-image types, while also providing one amongst several options convey caused-change. Altogether, expressions instantiate similar properties as unimodal both across
منابع مشابه
Representing Multimodal Linguistics Annotated data
The question of interoperability for linguistic annotated resources requires to cover different aspects. First, it requires a representation framework making it possible to compare, and potentially merge, different annotation schema. In this paper, a general description level representing the multimodal linguistic annotations is proposed. It focuses on time and data content representation: This...
متن کاملOperations on Multimodal Records: Towards a Computational Cognitive Linguistics
The report discusses a cognitive model in which a key concept is Multimodal Record (MMR)--an organized aggregate of transcripts of signals representing all information an Agent continuously acquired for a certain period of time. The MMR consists of a video track, sound track, and a number of tracks containing transcripts of the values of temperature, pressure, etc., as well as transcripts of st...
متن کاملA multimodal parallel architecture: A cognitive framework for multimodal interactions.
Human communication is naturally multimodal, and substantial focus has examined the semantic correspondences in speech-gesture and text-image relationships. However, visual narratives, like those in comics, provide an interesting challenge to multimodal communication because the words and/or images can guide the overall meaning, and both modalities can appear in complicated "grammatical" sequen...
متن کاملMultimodal Versus Unimodal Instructions
This module provides an overview of multimodal perception, including information Your nose might even be stimulated by the smell of burning rubber or gasoline. In other words, how does the perceptual system determine which unimodal between the two balls that then bounce off each other in opposite directions. Principles and heuristics for designing minimalist instruction. H Van der Multimodal ve...
متن کاملLinguistics 92 MULTIMODAL COMMUNICATION 2005 PROCEEDINGS from the Second Nordic Conference on Multimodal Communication
Speech and language science and technology evolved under the assumption that speech was a solely auditory event. However, a burgeoning record of research findings reveals that our perception and understanding are influenced by a speaker's face and accompanying gestures, as well as the actual sound of the speech. Perceivers expertly use these multiple sources of information to identify and inter...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Cognitive semantics
سال: 2022
ISSN: ['2352-6408', '2352-6416']
DOI: https://doi.org/10.1163/23526416-bja10025