In this paper, we consider the following stability problem for a novel dynamical queue. Independent and identical tasks arrive for a queue at a deterministic rate. The server spends deterministic state-dependent times to service these tasks, where the server state is governed by its utilization history through a simple dynamical model. Inspired by empirical laws for human performance as a funct...

This paper studies the Sensor Management (SM) problem for optical Space Object (SO) tracking. The tasking problem is formulated as a Markov Decision Process (MDP) and solved using Reinforcement Learning (RL). The RL problem is solved using the actor-critic policy gradient approach. The actor provides a policy which is random over actions and given by a parametric probability density function (p...

In this paper, we consider the downlink rate control problem in a wireless channel. A dynamic programming optimization method is introduced to obtain the optimal bit-rate/delay control policy in the downlink for packet transmission in wireless networks with fading channels. We assume that the base station is capable of transmitting data packets in the downlink with different bit rates, 0 1 1. I...

economic development plans normally contain some policy objectives, especially for the most important macroeconomic variables. governments are expected to take best policies to achieve these objectives, although due to some structural or other impediments they may fail to touch the objectives. we have attempted to uncover the determinants of private consumption and investment as the objectives ...