This course provides an overview of game theory with a special emphasis on its application to engineering applications and multiagent systems. Game theory focuses on the study of systems that are comprised of a collection of interacting and possibly competing decision making entities. Examples will be drawn from engineered, economics, and social models, including multivehicle robotics, data networks, sensor networks, and electronic commerce.

Resources Available: Lecture notes, presentation slides, homeworks

This course will cover the fundamentals of dynamic programming which is a method for solving complex problems by breaking them down into simpler subproblems. Topics include deterministic and stochastic formulations of the principle of optimality, value and policy iteration, introduction to finite state Markov chains, partial state information problems, stochastic shortest path problems, infinite horizon problems, and introduction to approximate dynamic programming. Applications include inventory control, finance, routing, and sequential hypothesis testing.

Resources Available: Youtube lectures, presentation slides, homeworks