很经典的Markov Chain的教材。


Markov Chains (Cambridge Series in Statistical and Probabilistic Mathematics)
By J. R. Norris

* Publisher: Cambridge University Press
* Number Of Pages: 256
* Publication Date: 1998-07-28
* ISBN-10 / ASIN: 0521633966
* ISBN-13 / EAN: 9780521633963
* Binding: Paperback

Product Description:
In this rigorous account the author studies both discrete-time and continuous-time chains. A distinguishing feature is an introduction to more advanced topics such as martingales and potentials, in the established context of Markov chains. There are applications to simulation, economics, optimal control, genetics, queues and many other topics, and a careful selection of exercises and examples drawn both from theory and practice. This is an ideal text for seminars on random processes or for those that are more oriented towards applications, for advanced undergraduates or graduate students with some background in basic probability theory.

Summary: the best introductory book on markov chains
Rating: 5
for a dumb math major graduate student like me, this is the best book. it explains things in an friendly, enlightening way, which makes you continue on reading through the pages. even for a probability major, this book is refreshing and full of joy.

Summary: Good introductory treatment, but has some issues
Rating: 3
This book has two principal aims. In the first half of the book, the aim is the study of discrete time and continuous time Markov chains. The first part of the text is very well written and easily accessible to the advanced undergraduate engineering or mathematics student.
My only complaint in the first half of the text regards the definition of continuous time Markov chains. The definition is introduced using the technical concepts of jump chain/holding time properties. This doesn't tie out well with the treatment of the discrete time case and may seem counter-intuitive to readers initially. However, the author does establish the equivalence of the jump chain/holding time definition to the usual transition probability definition towards the end of Chapter 2.
The second half of the text deals with the relationship of Markov chains to other aspects of stochastic analysis and the application of Markov chains to applied settings.
In Chapter 4, the material takes a serious jump (explosion?) in sophistication level. In this chapter, the author introduces filtrations, martingales, optional sampling/optional stopping and Brownian motion. This is entirely too ambitious a reading list to squeeze into the 40 or so pages allocated for all of this, in the opinion of this reviewer. The author places some prerequisite material in the appendix chapter.
Chapter 5 is a much more down-to-earth treatment of genuine applications of Markov chains. Birth/Death processes in biology, queuing networks in information theory, inventory management in operations research, and Markov decision processes are introduced via a series of very nice toy examples. This chapter wraps up with a nice discussion of simulation and the method of Markov chain Monte Carlo.
If the next edition of this book removes chapter 4 and replaces it with treatment of an actual real-world problem (or two) using genuine data sets, this reviewer would be happy to rate that edition 5 stars.


Summary: Everything about Markov Chains
Rating: 4
I used this book in my second year of Undergraduate Study and I would recommend it to anyone wanting a clear, consise book on Markov Chains. It covers a broad range of topics, and has many questions to check your understanding.
However, There are NOT answers to these questions so don't use this if you're looking for an easy way out of a homework sheet!
The best book I've read on the subject, without a doubt

Summary: Very useful if you have a good mathematical background!
Rating: 4