System-Level Modeling and Optimization Using Markov Decision Processes
This talk will discuss our ongoing work (in collaboration with Shuvra Bhattacharyya of the University of Maryland) to use Markov decision processes to model and optimize the operation of digital systems. The complexity of digital systems and their use cases leads us to the use of stochastic models. We show how to use hierarchical models to characterize communication systems and their environments. We will also discuss techniques to model the thermal behavior of systems using Markov decision processes.
Marilyn Wolf is Rhesa S. “Ray” Farmer Distinguished Chair in Embedded Computing Systems and Georgia Research Alliance Eminent Scholar at the Georgia Institute of Technology. She received her BS, MS, and PhD in electrical engineering from Stanford University in 1980, 1981, and 1984, respectively. She was with AT&T Bell Laboratories from 1984 to 1989. She was on the faculty of Princeton University from 1989 to 2007. Her research interests include cyber-physical systems, embedded computing, embedded video and computer vision, and VLSI systems. She has received the ASEE Terman Award and IEEE Circuits and Systems Society Education Award. She is a Fellow of the IEEE and ACM and an IEEE Computer Society Golden Core member.