Discrete-time markov control processes : basic optimality criteria
- New York: Springer, 1996
- xiv, 216 p.; : 24 cm.
- Applications of Mathematics, Stochastic Modelling and Applied Probability ; 30. .
This book provides a unified, comprehensive treatment of some recent theoretical developments on Markov control processes. Interest is mainly confined to MCPs with Borel state and control spaces, and possibly unbounded costs and non-compact control constraint sets. The control model studied is sufficiently general to include virtually all the usual discrete-time stochastic control models that appear in applications to engineering, economics, mathematical population processes, operations research, and management science. Much of the material appears for the first time in book form.
9780387945798 hbk
Discrete-time systems Mathematics Distribution (Probability theory) Linear program Markov Control Processes Markov processes