Discrete time Markov chains, Poisson processes, and renewal processes. Transient and limiting behavior. Average cost and utility measures of systems. Algorithms for computing performance measures. Modeling of inventories, and flows in manufacturing and computer networks. Crosslisted with ISYE 6761.