A Multi-modal Seq2seq Chatbot Framework
نویسندگان
چکیده
Abstract The pandemic has forced young people to stay away from school and friends, complete online learning at home live home. Therefore, various mental illnesses such as anxiety depression occur more frequently. Chatbot is a communication method that acceptable people. This paper proposes multi-modal chatbot seq2seq framework, which divides the state of into different types through information text images entered by users in chatbot. model combines image description summarization modules with attention mechanism control related content modalities. Experiments on data sets show this 70% average accuracy real who use system also believe good judgment ability.
منابع مشابه
Snowbot: An empirical study of building chatbot using seq2seq model with different machine learning framework
Chatbot is a growing topic, we built a open domain generative chatbot using seq2seq model with different machine learning framework (Tensorflow, MXNet). Our result show although seq2seq is a successful method in neural machine translation, use it solely on single turn chatbot yield pretty unsatisfactory result. Also existing free dialog corpus lacks both quality and quantity. Our conclusion it’...
متن کاملOctopus: A Multi Agent Chatbot
A Chatbot is a type of conversational agent or a computer program which has been designed to simulate an intelligent conversation with one or more human users via auditory or textual methods. Chatbots can be used as an exciting intelligent mechanism to interacting with computers. Undisputedly, Chatbots revolutionize the next generation of human-machine and machine-machine interaction in the con...
متن کاملExploiting Multi-Modal Interactions: A Unified Framework
Given an imagebase with tagged images, four types of tasks can be executed, i.e., content-based image retrieval, image annotation, text-based image retrieval, and query expansion. For any of these tasks the similarity on the concerned type of objects is essential. In this paper, we propose a framework to tackle these four tasks from a unified view. The essence of the framework is to estimate si...
متن کاملA Multi-modal Sensing Framework for Human Activity Recognition
Robots for the elderly are a particular category of home assistive robots, helping people in the execution of daily life tasks to extend their independent life. Such robots should be able to determine the level of independence of the user and track its evolution over time, to adapt the assistance to the person capabilities and needs. We present an heterogeneous information management framework,...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Electrical Engineering
سال: 2022
ISSN: ['1876-1100', '1876-1119']
DOI: https://doi.org/10.1007/978-981-19-2456-9_24