Includes bibliographical references (pages 312-315) and index.
1. Introduction -- Part I. Analysis of dynamic programming models -- 2. Monotone mappings underlying dynamic programming models -- 3. Finite horizon models -- 4. Infinite horizon models under a contraction assumption -- 5. Infinite horizon models under monotonicity assumptions -- 6. A generalized abstract dynamic programming model -- Part II. Stochastic optimal control theory -- 7. Borel spaces and their probability measures -- 8. The finite horizon Borel model -- 9. The infinite horizon Borel models -- 10. The imperfect state information model -- 11. Miscellaneous -- Appendixes: -- A. The outer integral -- B. Additional measurability properties of Borel spaces -- C. The Hausdorff metric and the exponential topology.