Given two labelled Markov decision processes (MDPs), the trace-refinement problem asks whether for all strategies of the first MDP there exists a strategy of the second MDP such that the induced labelled Markov chains are trace-equivalent. We show that this problem is decidable in polynomial time if the second MDP is a Markov chain. The algorithm is based on new results on a particular notion o...

-The set of all solutions of the minimal design problem (MDP) is presented in parametric form. This result is obtained by first deriving a parametric representation of all minimal bases of a particular vector space.From this the set of all solutions of the MDP are obtained. Then conditipns are placed on the. parameters, which conditions define set of stable solutions of the MDP. Solutions to th...

| Markov decision processes (MDPs) allow to represent a wide class of problems in medical decision making and control. The complexity of the algorithms used to search the best policy of a MDP is directly related with the dimensionality of the state space. A careful structuring of the state space is hence an important task in the MDP spe-ciication. Graphical models are particularly appealing to ...

Bayes-optimal behavior, while well-defined, is often difficult to achieve. Recent advances in the use of Monte-Carlo tree search (MCTS) have shown that it is possible to act near-optimally in Markov Decision Processes (MDPs) with very large or infinite state spaces. Bayes-optimal behavior in an unknown MDP is equivalent to optimal behavior in the known belief-space MDP, although the size of thi...

Stimulation of [(3)H]thymidine incorporation of thymocytes and splenocytes from guinea pigs by various bacterial cell walls and their peptidoglycans, by enzymatic digests, and by synthetic muramyl dipeptides was studied as an indication of mitogenic activity. Cell wall and peptidoglycan preparations, isolated from 19 strains belonging to 18 different species, definitely increased [(3)H]thymidin...

OBJECTIVE To investigate the role of macrophages in the development of laser-induced choroidal neovascularization (CNV) by selective depletion with liposomal clodronate (Cl(2)MDP-LIP). METHODS Laser photocoagulation was used to induce CNV in wild-type C57BL/6J mice. Animals were treated with intravenous (IV) and/or subconjunctival (SC) Cl(2)MDP-LIP or PBS-LIP at the following time points: 2 d...

BACKGROUND Dyspnoea, the feeling of breathing discomfort, consists of multiple dimensions that can vary in intensity, including the level of unpleasantness, qualities or descriptors of the sensation, emotional responses, and impact on function. No validated instrument for multidimensional measurement of dyspnoea is available in Swedish. The Multidimensional Dyspnea Profile (MDP) was recently de...

We consider a Reinforcement Learning setup where an agent interacts with an environment in observation-reward-action cycles without any (esp. MDP) assumptions on the environment. State aggregation and more generally feature reinforcement learning is concerned with mapping histories/raw-states to reduced/aggregated states. The idea behind both is that the resulting reduced process (approximately...

We studied the time course of humoral and cellular immunity of guinea pigs injected with the synthetic adjuvant N-acetylmuramyl L-alanyl-D-isoglutamine (MDP Pasteur, 10 microgram) in Freund incomplete adjuvant; the kinetics were compared with those obtained with Freund complete adjuvant (50 microgram of whole Mycobacterium butyricum). The antibody response to ovalbumin was faster and higher wit...