From the back cover: Power grids, flexible manufacturing, cellular communications: interconnectedness has consequences. This remarkable book gives the tools and philosophy you need to build network models detailed enough to capture essential dynamics but simple enough to expose the structure of effective control solutions. Core chapters assume only exposure to stochastic processes and linear algebra at undergraduate level; later chapters are for advanced graduate students and researchers/practitioners. This gradual development bridges classical theory with the state-of-the-art. The workload model at the heart of traditional analysis of the single queue becomes a foundation for workload relaxations used in the treatment of complex networks. Lyapunov functions and dynamic programming equations lead to the celebrated MaxWeight policy along with many generalizations. Other topics include methods for synthesizing hedging and safety stocks, stability theory for networks, and techniques for accelerated simulation. Examples and figures throughout make ideas concrete. Solutions to end-of-chapter exercises available on a companion website.

Published December 2007. For more information go to Cambridge University Press



Download table of contents, and appendix on Markov models
Download pre-publication draft



Solutions to selected exercises





'The first comprehensive account of some major strands of research in modeling, approximation, stability analysis and optimization of stochastic networks, from a leader in the field...Notable among these are its coverage of deterministic fluid limits, controlled random walk models, approximation via workload relaxation, and implications of these to stability and optimization of networks. Several important special instances are worked out in detail. A valuable resource for both researchers and practitioners'. Vivek S. Borkar, Tata Institute of Fundamental Research

Sean Meyn's text is a wonderful piece of work... It progresses through a series of important topics, running the gamut from modern control techniques for queueing system analysis, to optimization of deterministic network models, to computer simulation methods; and all the while, it provides rigorous mathematical foundations alongside a variety of clever, practical applications. The lively writing style and apt examples keep everything interesting, and I believe that readers will greatly appreciate and benefit from this unique book.' David M. Goldsman, Georgia Institute of Technology

'Sean Meyn's earlier book with Tweedie is the bible for economists who use Markov models to do everything from formulating asset pricing models to constructing Bayesian posteriors for dynamic models. This book is a gold mine of useful new ideas. I predict that the ideas in chapter 11 alone will have a big impact on the way we think about computing rational expectations equilibria.' Thomas Sargent, New York University