An introduction to sequential decision making under uncertainty. Much of the course is devoted to the theoretical, modeling, and computational aspects of Markov decision processes.