We use cookies to provide essential features and services. By using our website you agree to our use of cookies .


Warehouse Stock Clearance Sale

Grab a bargain today!

Markov Decision Processes


Product Description
Product Details

Table of Contents


1. Introduction.

2. Model Formulation.

3. Examples.

4. Finite-Horizon Markov Decision Processes.

5. Infinite-Horizon Models: Foundations.

6. Discounted Markov Decision Problems.

7. The Expected Total-Reward. Criterion.

8. Average Reward and Related Criteria.

9. The Average Reward Criterion-Multichain and Communicating Models.

10. Sensitive Discount Optimality.

11. Continuous-Time Models.



Appendix A. Markov Chains.

Appendix B. Semicontinuous Functions.

Appendix C. Normed Linear Spaces.

Appendix D. Linear Programming.



About the Author

Martin L. Puterman, PhD, is Advisory Board Professor of Operations and Director of the Centre for Operations Excellence at The University of British Columbia in Vancouver, Canada.

Ask a Question About this Product More...
Write your question below:
Look for similar items by category
Item ships from and is sold by Fishpond Retail Limited.
Back to top