Recurrent neural networks (RNNs) form an important class of architectures among neural networks useful for language modeling and sequential prediction. However, optimizing RNNs is known to be harder compared to feed-forward neural networks. A number of techniques have been proposed in literature to address this problem. In this paper we propose a simple technique called fraternal dropout that t...

Recently, dropout has seen increasing use in deep learning. For deep convolutional neural networks, dropout is known to work well in fully-connected layers. However, its effect in pooling layers is still not clear. This paper demonstrates that max-pooling dropout is equivalent to randomly picking activation based on a multinomial distribution at training time. In light of this insight, we advoc...

In this paper we analyze the major determinants of university enrollment and dropout in Brazil. The econometric model consists of two simultaneous equations. The first equation determines whether the student was accepted at the university or not; the second determines students decision to dropout or not from higher education, given they were accepted at the university. Gender, age and marriage ...

Long Short-Term Memory networks (LSTMs) are a component of many state-of-the-art DNN-based speech recognition systems. Dropout is a popular method to improve generalization in DNN training. In this paper we describe extensive experiments in which we investigated the best way to combine dropout with LSTMs– specifically, projected LSTMs (LSTMP). We investigated various locations in the LSTM to pl...

We consider the problem of designing models to leverage a recently introduced approximate model averaging technique called dropout. We define a simple new model called maxout (so named because its output is the max of a set of inputs, and because it is a natural companion to dropout) designed to both facilitate optimization by dropout and improve the accuracy of dropout’s fast approximate model...

BACKGROUND Nonscarring alopecia differs from scarring alopecia on pathologic examination by the preservation of follicular units and lack of follicular dropout. However, long-standing cases of active nonscarring hair loss can show follicular dropout on pathologic examination and can be difficult to interpret. OBSERVATIONS We describe a patient with nonscarring alopecia that was misdiagnosed a...

OBJECTIVE Chronic hepatitis C virus (HCV) infection is a serious health problem in Taiwan. The high dropout rate due to side effects limits the efficacy of treatment. The objective of this study is to investigate the effectiveness of telecare for the treatment of chronic hepatitis. MATERIAL AND METHODS Two hundred and ninety-eight patients randomly chose either of the two support programs. Gr...

BACKGROUND Individual-based interventions aim to improve patient self-management of chronic disease and to improve lifestyle among people at high risk, to reduce the prevalence of diseases contributing to health inequality. The present study investigates risk factors for uncompleted health interventions, via a combination of quantitative and qualitative methods. METHODS From a health centre i...

Approximately one in five patients drops out of treatment before its completion. Little is known about consistent predictors of dropout, and most studies focus on patients' demographic characteristics. A mass of information is collected daily at intake in clinical practice. Based on psychodynamic theoretical conceptualizations and accumulative clinical experience, this information may help pred...