This course concerns the optimization, control, and stabilization of dynamical systems under probabilistic uncertainty with applications in engineering systems and applied mathematics. Topics include: controlled and control-free Markov chains and stochastic stability; martingale methods for stability and stochastic learning; dynamic programming and optimal control for finite horizons, infinite horizons, and average cost problems; partially observed models, non-linear filtering and Kalman Filtering; linear programming and numerical methods; reinforcement learning and stochastic approximation methods; decentralized stochastic control, and continuous-time stochastic control. (Offered jointly with MTHE 472.) Three term -hours, fall or winter; lectures. (3.0 credit units) EXCLUSION: MTHE 472
This course concerns the optimization, control, and stabilization of dynamical systems under probabilistic uncertainty with applications in engineering systems and applied mathematics. Topics include: controlled and control-free Markov chains and stochastic stability; martingale methods for stability and stochastic learning; dynamic programming and optimal control for finite horizons, infinite horizons, and average cost problems; partially observed models, non-linear filtering and Kalman Filtering; linear programming and numerical methods; reinforcement learning and stochastic approximation methods; decentralized stochastic control, and continuous-time stochastic control. (Offered jointly with MTHE 472.) Three term -hours, fall or winter; lectures. (3.0 credit units) EXCLUSION: MTHE 472
