6.S979 Topics in Deployable ML -- Fall 2019
Instructors: Konstantinos Daskalakis, Aleksander Mądry, Ankur Moitra, Asuman Ozdaglar, Pablo Parrilo, Martin Rinard, Arvind Satyanarayan, Armando Solar-Lezama, David Sontag, Russ Tedrake, Antonio TorralbaTime and place: Tuesdays and Thursdays 12:30-2 pm in 32-144
Units: 3-0-9 (H level)
Prerequisites
Course description
Today’s ML solutions can achieve impressive—sometimes super-human—performance that suggests that a broad deployment of ML will revolutionize almost every aspect of our lives. However, much of its development so far has been focused on clean and controlled/simulated settings and has had an average-case/“proof of concept” perspective in mind. And this mindset, despite being very useful up until now, turns out to be grossly inadequate for the—often high-stakes—nature of real-world deployment of ML. Here, the chief design goal is robustness to the variety of corruptions that abound in real-world contexts, whether benign or malicious in nature. It is also necessary to have a fine-grained grasp of the biases learned by our models and the impact of employing them in decision making. Finally, to be truly useful, our ML tools need to be understandable to humans and easy to work with even for users with no ML expertise.
The current ML toolkit tends to fail catastrophically with respect to the above criteria. As such, we need a new, multi-pronged effort that will revisit all the tenets of the existing ML framework and build the next generation of machine learning that can be deployed in the real world in a safe, secure and responsible manner.
This course will begin with background lectures, and then shift into a series of lectures (given by co-instructors) about fundamental ideas and phenomena that are relevant to building a truly deployable ML. Class projects will then require the students to explore these topics in more depth and present them in a form of a presentation and report.
- (Thursday, 9/5) Introduction and Course Overview + Continuous Optimization Fundamentals [Aleksander Mądry]
- (Tuesday, 9/10) Continuous Optimization in Deep Learning [Aleksander Mądry]
- (Thursday, 9/12) Optimization and Generalization Challenges in Deep Learning [Aleksander Mądry]
- (Tuesday, 9/17) Adversarial Robustness [Aleksander Mądry]
- (Thursday, 9/19) Data Poisoning/Robust Statistics [Ankur Moitra]
- (Tuesday, 9/24) Robustness to Distribution Shift and Biases [Costis Daskalakis]
- (Thursday, 9/26) Causal Inference and Predicting Counterfactuals I [David Sontag]
- (Tuesday, 10/1) Min-Max Optimization I [additional note] [Costis Daskalakis]
- (Thursday, 10/3) Min-Max Optimization II [Asuman Ozdaglar]
- (Tuesday, 10/8) Control Theory Fundamentals [Pablo Parrilo]
- (Thursday, 10/10) (Deep) Reinforcement Learning [Aleksander Mądry]
- (Tuesday, 10/15) No lecture (Columbus Day)
- (Thursday, 10/17) Causal Inference and Predicting Counterfactuals II [David Sontag]
- (Tuesday, 10/22) Verification of ML models [Martin Rinard]
- (Thursday, 10/24) Deployable robotics I [Russ Tedrake]
- (Tuesday, 10/29) Deployable robotics II [Russ Tedrake]
- (Thursday, 10/31) Learning Graphical Models [Ankur Moitra]
- (Tuesday, 11/5) Dissecting Neural Networks [Antonio Torralba]
- (Thursday, 11/7) Multimodal Self-Supervised Learning [Antonio Torralba]
- (Tuesday, 11/12) Intro to the Human-Centered Design Process [Arvind Satyanarayan]
- (Thursday, 11/14) Interfaces and Visualizations for Interpretability [Arvind Satyanarayan]
- (Tuesday, 11/19) Reasoning about Learned Systems I [Armando Solar-Lezama]
- (Thursday, 11/21) Reasoning about Learned Systems II [Armando Solar-Lezama]
- (Tuesday, 11/26) Active Learning of Computer Programs [Martin Rinard]
- (Thursday, 11/28) No lecture (Thanksgiving)
- (Tuesday, 12/3) Artificial Intelligence + Decisions [Asuman Ozdaglar/Pablo Parrilo]
- (Thursday, 12/5) Societal Impact of ML [Arvind Satyanarayan/Aleksander Mądry]
- (Tuesday, 12/10) Project Presentations