Convergence of the Wake-Sleep Algorithm
نویسندگان
چکیده
The W-S (Wake-Sleep) algorithm is a simple learning rule for the models with hidden variables. It is shown that this algorithm can be applied to a factor analysis model which is a linear version of the Helmholtz machine. But even for a factor analysis model, the general convergence is not proved theoretically. In this article, we describe the geometrical understanding of the W-S algorithm in contrast with the EM (ExpectationMaximization) algorithm and the em algorithm. As the result, we prove the convergence of the W-S algorithm for the factor analysis model. We also show the condition for the convergence in general models.
منابع مشابه
A novel sleep/wakeup power management in wireless sensor network: A Fuzzy TOPSIS approach
The wireless sensor network (WSN) is typically comprised many tiny nodes equipped with processors, sender/receiver antenna and limited battery in which it is impossible or not economic to recharge. Meanwhile, network lifespan is one of the most critical issues because of limited and not renewal used battery in WSN. Several mechanisms have been proposed to prolong network lifespan such as LEACH,...
متن کاملA novel sleep/wakeup power management in wireless sensor network: A Fuzzy TOPSIS approach
The wireless sensor network (WSN) is typically comprised many tiny nodes equipped with processors, sender/receiver antenna and limited battery in which it is impossible or not economic to recharge. Meanwhile, network lifespan is one of the most critical issues because of limited and not renewal used battery in WSN. Several mechanisms have been proposed to prolong network lifespan such as LEACH,...
متن کاملEffect of Acute and Chronic Heat Exposure on Frequency of EEG Components in Different Sleep-Wake State in Young Rats
The recent literatures indicate that central nervous system (CNS) is highly vulnerable to systemic hyperthermia induced by whole body heating on conscious animals. In the present study, cerebral electrical activity or EEG (electroencephalogram) following exposure to high environmental heat has been studied in moving rats. Rats were divided into three group (i) acute heat stress-subjected to a s...
متن کاملEvaluation of the Effect of Nest Posture on the Sleep-wake State of Premature Infants
Background: Premature birth is a major cause of infant mortality in developed countries. Newborns confined to neonatal intensive care units (NICUs) are in a rapid stage of brain development. As such, sleep plays a pivotal role in the proper brain development of newborns. However, this developmental aspect is often disregarded due to the lack of information. Aim: This study aimed to evaluate the...
متن کاملConvergence of Approximations to Riccati-based Boundary-feedback Stabilization of Laminar Flows
Riccati-based feedback is commonly applied for the stabilization of flows in theory and in simulations. Nonetheless, there are few attempts to show the convergence of numerically computed feedback gains to the feedback defined by the actual model. In this work, we investigate how standard finite-dimensional formulations approximate the system dynamics and provide sufficient conditions for the c...
متن کامل