Table of Contents

A General Framework for Markov Decision Processes.

Algorithms.

Linear Programming Formulations for Markov DecisionProcesses.

Semi-Markov Decision Processes.

Partially Observable and Adaptive Markov Decision Processes.

Further Aspects of Markov Decision Processes.

Some Markov Decision Process Problems, Formulations and OptimalityEquations.

References.

Solutions to Exercises.

Index.

About the Author

D. J. White is the author of Markov Decision Processes, published by Wiley.