The second edition of Markov Processes provides a bridge from an undergraduate probability course to a course in stochastic processes. The text is designed to be understandable to students who have taken an undergraduate probability course without needing an instructor to fill in any gaps.
Inhaltsverzeichnis
Preface to Second Edition 1. Review of Probability 2. Discrete-Time, Finite-State Markov Chains 3. Discrete-Time, Infinite-State Markov Chains 4. Exponential Distribution and Poisson Process 5. Continuous Time Markov Chains 6. Queuing Models and Detailed Balance Equations 7. Reversible Markov Chains 8. Digraphs