Abstract This paper focuses on gaining new knowledge through observation, qualitative analytics, and cross-modal fusion of rich multi-layered conversational features expressed during multiparty discourse. The outlined research stems from the theory that speech co-speech gestures originate same representation; however, representation is not solely limited to production process. Thus, nature how ...