"Optimizing Intended Reward Functions" - Anca Dragan

Optimizing Intended Reward Functions: Extracting all the right information from all the right places: Anca Dragan (UC Berkeley)

Abstract: AI work tends to focus on how to optimize a specified reward function, but rewards that lead to the desired behavior consistently are not so easy to specify. Rather than optimizing specified reward, which is already hard, robots have the much harder job of optimizing intended reward. While the specified reward does not have as much information as we make our robots pretend, the good news is that humans constantly leak information about what the robot should optimize. In this talk, we will explore how to read the right amount of information from different types of human behavior -- and even the lack thereof.

Biography: Anca Dragan is an Assistant Professor in EECS at UC Berkeley, where she runs the InterACT lab. Her goal is to enable robots to work with, around, and in support of people. She works on algorithms that enable robots to a) coordinate with people in shared spaces, and b) learn what people want them to do. Anca did her PhD in the Robotics Institute at Carnegie Mellon University on legible motion planning. At Berkeley, she helped found the Berkeley AI Research Lab, is a co-PI for the Center for Human-Compatible AI, and has been honored by the Presidential Early Career Award for Scientists and Engineers (PECASE), the Sloan fellowship, the NSF CAREER award, the Okawa award, MIT's TR35, and an IJCAI Early Career Spotlight.

“Robotics Today - A series of technical talks” is a new virtual robotics seminar series. The goal of the series is to bring the robotics community together during these challenging times.The seminars are scheduled on Fridays at 1PM EDT (10AM PDT) are open to the public. The format of the seminar consists of a technical talk live captioned and streamed via Web (https://roboticstoday.github.io/watch...) and Twitter (@RoboticsSeminar), followed by an interactive discussion between the speaker and a panel of faculty, postdocs, and students that will moderate audience questions.

Website: https://roboticstoday.github.io/
Twitter:   / roboticsseminar  
Calendar: https://calendar.google.com/calendar/...

OUTLINE:
0:00 Opening Remarks in support of Black Lives Matter
1:46 Introduction
3:49 Anca's Talk
55:28 Panel Discussion
1:21:03 Concluding Remarks