A Partially Observable Markovian Maintenance Process with Continuous Cost Functions
author
Abstract:
In this paper a two-state Markovian maintenance process where the true state is unknown will be considered. The operating cost per period is a continuous random variable which depends on the state of the process. If investigation cost is incurred at the beginning of any period, the system wit I be returned to the "in-control" state instantaneously. This problem is solved using the average criteria. The method involves exploiting the structure of the problem to develop an algorithm which is shown to be more efficient than the usual dynamic programming approach. Results of extensive tests show the accuracy of this algorithm. In addition, it is shown that if certain condition is satisfied, then it is possible to find the average cost per period by a simple calculation.
similar resources
EPQ model with depreciation cost and process quality cost as continuous functions of time
Extensive research has been devoted to economic production quantity (EPQ) problem. However, little atten-tion has been paid to problems where depreciation cost and process quality cost must be considered, simulta-neously. In this paper, we consider the economic production quantity model of minimizing the annual total cost subject to depreciation cost and process quality cost, where depreciation...
full textPlanning for AUVs: Dealing with a Continuous Partially-Observable Environment
We describe the domain of using an Autonomous Underwater Vehicle to find hydrothermal vents located on the sea floor, and explain some of the difficulties in planning in this domain. We also present a simplified model of the domain, and outline a possible approach for on-line plan generation.
full textepq model with depreciation cost and process quality cost as continuous functions of time
extensive research has been devoted to economic production quantity (epq) problem. however, little atten-tion has been paid to problems where depreciation cost and process quality cost must be considered, simulta-neously. in this paper, we consider the economic production quantity model of minimizing the annual total cost subject to depreciation cost and process quality cost, where depreciation...
full textRobot Planning in Partially Observable Continuous Domains
We present a value iteration algorithm for learning to act in Partially Observable Markov Decision Processes (POMDPs) with continuous state spaces. Mainstream POMDP research focuses on the discrete case and this complicates its application to, e.g., robotic problems that are naturally modeled using continuous state spaces. The main difficulty in defining a (belief-based) POMDP in a continuous s...
full textPartially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities
Authors are encouraged to submit new papers to INFORMS journals by means of a style file template, which includes the journal title. However, use of a template does not certify that the paper has been accepted for publication in the named journal. INFORMS journal templates are for the exclusive purpose of submitting to an INFORMS journal and should not be used to distribute the papers in print ...
full textLearning Without State-Estimation in Partially Observable Markovian Decision Processes
Reinforcement learning RL algorithms pro vide a sound theoretical basis for building learning control architectures for embedded agents Unfortunately all of the theory and much of the practice see Barto et al for an exception of RL is limited to Marko vian decision processes MDPs Many real world decision tasks however are inherently non Markovian i e the state of the environ ment is only incomp...
full textMy Resources
Journal title
volume 1 issue 4
pages 201- 210
publication date 1988-11-01
By following a journal you will be notified via email when a new issue of this journal is published.
Hosted on Doprax cloud platform doprax.com
copyright © 2015-2023