A Multi-modal Seq2seq Chatbot Framework

نویسندگان

چکیده

Abstract The pandemic has forced young people to stay away from school and friends, complete online learning at home live home. Therefore, various mental illnesses such as anxiety depression occur more frequently. Chatbot is a communication method that acceptable people. This paper proposes multi-modal chatbot seq2seq framework, which divides the state of into different types through information text images entered by users in chatbot. model combines image description summarization modules with attention mechanism control related content modalities. Experiments on data sets show this 70% average accuracy real who use system also believe good judgment ability.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Snowbot: An empirical study of building chatbot using seq2seq model with different machine learning framework

Chatbot is a growing topic, we built a open domain generative chatbot using seq2seq model with different machine learning framework (Tensorflow, MXNet). Our result show although seq2seq is a successful method in neural machine translation, use it solely on single turn chatbot yield pretty unsatisfactory result. Also existing free dialog corpus lacks both quality and quantity. Our conclusion it’...

متن کامل

Octopus: A Multi Agent Chatbot

A Chatbot is a type of conversational agent or a computer program which has been designed to simulate an intelligent conversation with one or more human users via auditory or textual methods. Chatbots can be used as an exciting intelligent mechanism to interacting with computers. Undisputedly, Chatbots revolutionize the next generation of human-machine and machine-machine interaction in the con...

متن کامل

Exploiting Multi-Modal Interactions: A Unified Framework

Given an imagebase with tagged images, four types of tasks can be executed, i.e., content-based image retrieval, image annotation, text-based image retrieval, and query expansion. For any of these tasks the similarity on the concerned type of objects is essential. In this paper, we propose a framework to tackle these four tasks from a unified view. The essence of the framework is to estimate si...

متن کامل

A Multi-modal Sensing Framework for Human Activity Recognition

Robots for the elderly are a particular category of home assistive robots, helping people in the execution of daily life tasks to extend their independent life. Such robots should be able to determine the level of independence of the user and track its evolution over time, to adapt the assistance to the person capabilities and needs. We present an heterogeneous information management framework,...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Electrical Engineering

سال: 2022

ISSN: ['1876-1100', '1876-1119']

DOI: https://doi.org/10.1007/978-981-19-2456-9_24