您当前所在位置: 首页 > 学者

郭先平

  • 75浏览

  • 0点赞

  • 0收藏

  • 0分享

  • 157下载

  • 0评论

  • 引用

期刊论文

CONTINUOUS-TIME CONTROLLED MARKOV CHAINS1

郭先平BY XIANPING Gu AND ONESIMO HERNANDEZ-LERMA

The Annals of Applied Probability 2003, V01. 13, No.1, 363-388,-0001,():

URL:

摘要/描述

This paper concerns studies on continuous-time controlled Markov chains, that is, continuous-time Markov decision processes with a denumer-able state space, with respect to the discounted cost criterion. The cost and transition rates are allowed to be unbounded and the action set is a Borel space. We first study control problems in the class of determini stic station-ary policies and give very weak conditions under which the exi stence of ε-optimal (ε≥0) policies is proved using the construction of a minimum Q-process. Then we further consider control problems in the class of ran-domized Markov policies for (1) regular and (2) nonregular Q-processes. To study case (1), first we present a new necessary and sufficient condition for a nonhomogeneous Q-process to be regular. This regularity condition, together with the extended generator of a nonhomogeneous Markov process. is used to prove the existence of e-optimal stationary policies. Our results for case (1) are illustrated by a Schl6gl model with a controlled diffusion. F0r case (2), we obtain a similar result using Kolmogorov' s forward equation for the min. imum Q-process and we also present an example in which our assumptions are satisfied, but those used in the previous literature fail to hold.

【免责声明】以下全部内容由[郭先平]上传于[2006年10月12日 02时16分27秒],版权归原创者所有。本文仅代表作者本人观点,与本网站无关。本网站对文中陈述、观点判断保持中立,不对所包含内容的准确性、可靠性或完整性提供任何明示或暗示的保证。请读者仅作参考,并请自行承担全部责任。

我要评论

全部评论 0

本学者其他成果

    同领域成果