Controlled Markov Processes (Grundlehren der mathematischen Wissenschaften)

This book is devoted to the systematic exposition of the contemporary theory of controlled Markov processes with discrete time parameter or in another termi nology multistage Markovian decision processes. We discuss the applications of this theory to various concrete problems. Particular attention is paid to mathe matical models of economic planning, taking account of stochastic factors. The authors strove to construct the exposition in such a way that a reader interested in the applications can get through the book with a minimal mathe matical apparatus. On the other hand, a mathematician will find, in the appropriate chapters, a rigorous theory of general control models, based on advanced measure theory, analytic set theory, measurable selection theorems, and so forth. We have abstained from the manner of presentation of many mathematical monographs, in which one presents immediately the most general situation and only then discusses simpler special cases and examples. Wishing to separate out difficulties, we introduce new concepts and ideas in the simplest setting, where they already begin to work. Thus, before considering control problems on an infinite time interval, we investigate in detail the case of the finite interval. Here we first study in detail models with finite state and action spaces-a case not requiring a departure from the realm of elementary mathematics, and at the same time illustrating the most important principles of the theory.
ASIN: 0387903879
VSKU: BVV.0387903879.A
Condition: Acceptable
Author/Artist:Dynkin, E B
Binding: Hardcover
Note: Any images shown are stock photographs and product may differ from what is shown.
Condition Notes: Former library book with the usual stamps, stickers and labels. The item is very worn but continues to work perfectly. Signs of wear can include aesthetic issues such as scratches, dents and worn corners. All pages and the cover are intact, but the dust cover may be missing. Pages may include moderate to heavy amount of notes and highlighting,but the text is not obscured or unreadable. May NOT include discs, access code or other supplemental materials.