Multi-modal Target Prediction
نویسندگان
چکیده
Users with severe motor impairment often depends on alternative input devices like eye-gaze or head movement trackers to access computers. However these devices are not as fast as computer mouse and often turn difficult to use. We have proposed a Neural-network based model that can predict pointing target by analyzing pointing trajectory. We have validated the model for standard computer mouse, eye-gaze and head movement trackers. The model is used to develop an adaptation system that can statistically significantly reduce pointing times.
منابع مشابه
Methodology For Evaluating Statistically Predicted Versus Measured Imagery
We present a novel methodology for evaluating statistically predicted versus measured multi-modal imagery, such as Synthetic Aperture Radar (SAR), Electro-Optical (EO), Multi-Spectral (MS) and Hyper-Spectral (HS) modalities. While several scene modeling approaches have been proposed in the past for multi-modal image predictions, the problem of evaluating synthetic and measured images has remain...
متن کاملLearning by Actively Querying Strong Modal Features
Complex objects are usually with multiple modal features. In multi-modal learning, modalities closely related to the target tasks are known as strong modalities. While collecting strong modalities of all instances is often expensive, and current multi-modal learning techniques hardly take the strong modal feature extraction expenses into consideration. On the other hand, active learning is prop...
متن کاملALADIN: A New Approach for Drug-Target Interaction Prediction
Due to its pharmaceutical applications, one of the most prominent machine learning challenges in bioinformatics is the prediction of drug–target interactions. State-of-the-art approaches are based on various techniques, such as matrix factorization, restricted Boltzmann machines, network-based inference and bipartite local models (BLM). In this paper, we extend BLM by the incorporation of a hub...
متن کاملMulti-modal respiratory motion prediction using sequential forward selection method
In robotic radiotherapy, systematic latencies have to be compensated by prediction of external optical surrogates. We investigate possibilities to increase the prediction accuracy using multi-modal sensors. The measurement setup includes position, acceleration, strain and flow sensors. To select the most relevant and least redundant information from the sensors and to limit the size of the feat...
متن کاملImage-Text Multi-Modal Representation Learning by Adversarial Backpropagation
We present novel method for image-text multi-modal representation learning. In our knowledge, this work is the first approach of applying adversarial learning concept to multi-modal learning and not exploiting image-text pair information to learn multi-modal feature. We only use category information in contrast with most previous methods using image-text pair information for multi-modal embeddi...
متن کامل