Many modern texts oversimplify or skip the Markov chain theory, jumping straight to simulation scripts. Stewart refuses to compromise. He knows that if you don’t understand the steady-state equations of a Markov chain, you won’t truly understand why your simulation output sometimes oscillates or fails to converge. No book is perfect. Stewart’s coverage of non-Markovian queues (like G/G/1) is light—he points to approximations (Kingman’s formula, Whitt’s QNA) but doesn’t develop them deeply. Also, the simulation code examples are in a pseudo-language that some readers might find dated; you’ll need to translate to your preferred language. But these are minor quibbles. The Takeaway William J. Stewart’s Probability, Markov Chains, Queues, and Simulation is not just a textbook. It’s a key to seeing the world differently. After you read it, a checkout line is no longer an annoyance—it’s a continuous-time Markov chain with finite waiting room. A busy website is a Jackson network of queues. Your email inbox is a discrete-time queue with a priority scheduler.
The exercises are excellent—theoretical derivations, computational problems, and open-ended modeling challenges. Many problems explicitly ask you to implement a simulation in a language of your choice (pseudocode is given, but the ideas translate to Python, R, MATLAB, or Julia). You might wonder: why not a newer book? Some topics (like cloud computing or modern load balancing) aren’t covered, but the fundamentals haven’t aged a day. Stewart’s clarity, structure, and mathematical care remain unmatched. The hardcover binding is also a pleasure—this is a book you’ll keep open on your desk for years, flipping between the Markov chain chapter and the simulation appendix. Many modern texts oversimplify or skip the Markov
This isn’t just a textbook. It’s a bridge between abstract probability theory and the real-world systems that run our lives: computer networks, call centers, manufacturing lines, hospital emergency rooms, and even the traffic on your morning commute. Many textbooks on queuing theory fall into two traps: they’re either too abstract (pure measure theory, no intuition) or too recipe-driven (here’s the M/M/1 formula, memorize it). Stewart avoids both. He writes with the precision of an applied mathematician and the clarity of an engineer. No book is perfect
And you’ll know how to measure, model, and improve them all. But these are minor quibbles
That feeling—the strange, frustrating dance of randomness, service, and waiting—is the domain of performance modeling. And if there’s one book that unlocks its mathematical soul, it’s William J. Stewart’s (2009, hardcover).
If you work in performance modeling—or just want to understand why you always seem to pick the slowest line—track down the 2009 hardcover. It’s a masterclass in the mathematics of waiting, written by a master teacher. “The world is not deterministic. It is stochastic, full of queues and Markov chains. Stewart helps you see the order within the randomness.”