Continuous-time Zero-Sum Games for Markov decision processes under the risk-sensitive first passage discounted cost criterion

Read the full article See related articles

Listed in

This article is not in any list yet, why not save it to one of your lists.
Log in to save this article

Abstract

We analyze zero-sum stochastic games for controlled continuous-time Markov decision processes (CTMDPs) over a general state space, employing the risk- sensitive first-passage discounted cost criterion. Both transition and cost rates may be unbounded. Assuming stability, we prove the existence and uniqueness of the solution to the Hamilton-Jacobi-Isaacs (HJI) equation through a value iteration approach. By applying the Feynman-Kac formula, we confirm the presence of a saddle-point equilibrium among Markov strategies, describing it via the associated HJI equation. Lastly, we validate our findings and assumptions with numerical examples.

Article activity feed