This is the second of the three course sequence in stochastic models. The course will cover the following major topics:

1. Continuous Time Markov Chains (10 Lectures)
2. Queueing Systems (6 Lectures)
3. Renewal Processes (8 Lectures)
4. Markov Regenerative Processes (5 Lectures)

Text:

Modeling and Analysis of Stochastic systems,

by V. G. Kulkarni, 1995, CRC Press.

References:

1. Stochastic Processes, by S. M. Ross,
2. Stochastic Models in Operations Research, by D. P. Heyman and M. J. Sobel,
3. Introduction to Stochastic Processes, by E. Cinlar,
4. A First Course in Stochastic Processes, by S. Karlin and H. Taylor.
 
 

The course evaluation will be based on

1. Ten best out of 12 to 13 homeworks (20%)
2. Mid-term (40%)
3. Final (40%) 

The mid-term is take home, while the final is in class. Both are open-book, open-notes.