Optimization, control, and stabilization of dynamical systems under probabilistic uncertainty with applications in engineering systems and applied mathematics. Topics include controlled and control-free Markov chains, stochastic stability, martingale methods for stability, stochastic learning, dynamic programming, optimal control for finite and infinite horizons, average cost problems, partially observed models, non-linear and Kalman filtering, linear programming and numerical methods, reinforcement learning and stochastic approximation methods, decentralized and continuous time stochastic control.
Optimization, control, and stabilization of dynamical systems under probabilistic uncertainty with applications in engineering systems and applied mathematics. Topics include controlled and control-free Markov chains, stochastic stability, martingale methods for stability, stochastic learning, dynamic programming, optimal control for finite and infinite horizons, average cost problems, partially observed models, non-linear and Kalman filtering, linear programming and numerical methods, reinforcement learning and stochastic approximation methods, decentralized and continuous time stochastic control.