We consider approximate policy evaluation for finite state and action Markov decision processes (MDP) in the off-policy learning context and with the simulation-based least squares temporal difference algorithm, LSTD(λ). We establish for the discounted cost criterion that the off-policy LSTD(λ) converges almost surely under mild, minimal conditions. We also analyze other convergence and bounded...

In order to solve the problem of unbalanced industrial development, promote industrial structure optimization and guide the orderly transfer of industries, Guangdong Province issued Decision on Promoting Industry Transfer and Labor Force Transfer and a series of other supporting policies. This article aims to analyze the framework, practical significance and effect of industrial transfer and la...

Information security is an understudied area within electronic government. In this study, we examine the quality of information security policy design in health care. Employees cause a majority of the security breaches in health care, and many of them are unintentional. In order to support the formulation of practical, from the employees’ perspective, information security policies, we propose e...

It is very hard, if not impossible, to obtain by using dynamic programming the optimal policy for a stochastic linear production-inventory system. Therefore simplifications are necessary. Mostly in practical situations a certainty-eauivalence policy is adopted. Another approach is that developed by Holt, Modigliani, Muth and Simon (HMMS) 14 1. They approximate the cost functions by quadratics a...

The text of this book is composed in Baskerville, with display type set in Optima. Macroeconomic policy in a world economy : from econometric design to practical operation / John B. Taylor. p. cm.

This paper addresses this key issue by enabling the participation of the citizen in formulating Malaysia’s public policy through e-participation. Currently, there is no e-participation framework for citizen to involve in Malaysia’s public policy formulation. Most public policy formulate by certain group of expertise but the feedback from citizen still lacking. The research embraces the socio-te...

Policies are rules governing the choices in behaviour of a system. They are increasingly being used as a means of implementing flexible and adaptive systems for management of internet services, networks, and security systems. There is also a need for a common specification of security policy for large-scale, multi-organisational systems where access control is implemented in a variety of hetero...

In this paper, we develop an agent-based model of a market game in order to evaluate the effectiveness of the UK government’s 2008-2010 policy on promoting smart metering. We also consider possible supplementary strategies. With the model, we test the effectiveness of four possible strategy options and suggest their policy implications. The context of the paper is a practical application of age...

This paper considers a condition-based maintenance model for continuously degrading systems under continuous monitoring. After maintenance, the states of the system are randomly distributed with residual damage. We investigate a realistic maintenance policy, referred to as condition-based availability limit policy, which achieves the maximum availability level of such a system. The optimum main...

There are many practical situations that have both features of customer retrials and server vacations. The vacation policy is characterized by the vacation startup rules and vacation termination rules. The queueing system with retrials and vacations has been described in variety of ways according to the vacation rules and retrial policies such as constant retrial policy and linear retrial polic...