Quasi-Unimodal Distributions for Ordinal Classification
نویسندگان
چکیده
Ordinal classification tasks are present in a large number of different domains. However, common losses for deep neural networks, such as cross-entropy, do not properly weight the relative ordering between classes. For that reason, many have been proposed literature, which model output probabilities following unimodal distribution. This manuscript reviews these on three datasets and suggests potential improvement focuses constraint neighborhood around true class, allowing more flexible distribution, aptly called quasi-unimodal loss. this purpose, two constraints proposed: A first concerns order top-three probabilities, second ensures remaining higher than top three. Therefore, gradient descent improving decision boundary class detriment to distant The loss is found be competitive several cases.
منابع مشابه
Unimodal Probability Distributions for Deep Ordinal Classification
Probability distributions produced by the crossentropy loss for ordinal classification problems can possess undesired properties. We propose a straightforward technique to constrain discrete ordinal probability distributions to be unimodal via the use of the Poisson and binomial probability distributions. We evaluate this approach in the context of deep learning on two large ordinal image datas...
متن کاملThe unimodal model for the classification of ordinal data
Many real life problems require the classification of items into naturally ordered classes. These problems are traditionally handled by conventional methods intended for the classification of nominal classes where the order relation is ignored. This paper introduces a new machine learning paradigm intended for multi-class classification problems where the classes are ordered. The theoretical de...
متن کاملSegmentation and classification of time series using ordinal pattern distributions
The distribution of ordinal patterns in time series has been found to reflect important qualitative features of the underlying system dynamics. Abrupt changes in the dynamics typically result in clearly visible differences between the distributions before and after the break. Recurring dynamical regimes can be discovered by classifying the distributions in different parts of the time series. Th...
متن کاملProperties of Unimodal Distributions and Some of Their Applications
This article has no abstract.
متن کاملOn discrete a-unimodal and a-monotone distributions
Unimodality is one of the building structures of distributions that like skewness, kurtosis and symmetry is visible in the shape of a function. Comparing two different distributions, can be a very difficult task. But if both the distributions are of the same types, for example both are unimodal, for comparison we may just compare the modes, dispersions and skewness. So, the concept of unimodali...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematics
سال: 2022
ISSN: ['2227-7390']
DOI: https://doi.org/10.3390/math10060980