This course is a formal introduction to stochastic processes with applications. The main topics are discrete and continuous time Markov chains, Poisson processes, random walks, branching processes, first passage times, recurrence and transience, and stationary distributions. The course also covers Brownian motion and martingales. Other topics may include renewal processes, queues, optimal stopping theory, Monte Carlo methods, and stochastic integration.
Prerequisites
None