Convex Optimization: Spring 2015

Machine Learning 10-725
(cross-listed as Statistics 36-725)

Instructor: Ryan Tibshirani (ryantibs at cmu dot edu)

TAs:
Mattia Ciollaro (ciollaro at cmu dot edu)
Junier Oliva (joliva at cs dot cmu dot edu)
Nicole Rafidi (nrafidi at cs dot cmu dot edu)
Veeranjaneyulu Sadhanala (vsadhana at cs dot cmu dot edu)
Yu-Xiang Wang (yuxiangw at cs dot cmu dot edu)

Course assistant: Mallory Deptola (mdeptola at cs dot cmu dot edu)

Lecture times: Mondays and Wednesdays 10:30-11:50am, Hamburg Hall 1000

Office hours:
RT: Mondays 12-1pm, Baker 229B
MC: Mondays 1-2pm, Wean 8110
JO: Fridays 1-2pm, GHC 8229
NR: Tuesdays 1.30-2.30pm, common area on 8th floor of GHC
VS: Thursdays 5-6pm, GHC 8005
YW: Wednesdays 3-4pm, common area on 8th floor of GHC

Syllabus: here

Scribing: Sign up for scribing here, and find the Latex scribing template here

Discussions: Class discussions will be run through Piazza, linked here

Go to:   Schedule | Assignments | Miscellaneous

Schedule

Here is the estimated class schedule. It is subject to change, depending on time and class interests.

Theory I: Fundamentals
Mon Jan 12 Introduction Slides, notes, video Quiz Scribe
Wed Jan 14 Convexity I: Sets and functions Slides, notes, video Quiz Scribe
Mon Jan 19 (MLK day, no class)
Wed Jan 21 Convexity II: Optimization basics Slides, notes, video Quiz Scribe
Mon Jan 26 Canonical problem forms Slides, notes, video Quiz Scribe
Algorithms I: First-order methods
Wed Jan 28 Gradient descent Slides, notes, video Quiz Scribe Hw 1 due (Thu)
Mon Feb 2 Subgradients Slides, notes, video Quiz Scribe
Wed Feb 4 Subgradient method Slides, notes, video Quiz Scribe
Mon Feb 9 Proximal gradient descent, acceleration Slides, notes, video Quiz Scribe
Wed Feb 11 Numerical linear algebra primer Slides, notes, video Quiz Scribe Project milestone 1 due
Theory II: Optimality and duality
Mon Feb 16 Duality in linear programs Slides, notes, video Quiz Scribe Hw 2 due (Tue)
Wed Feb 18 Duality in general programs Slides, notes, video Quiz Scribe
Mon Feb 23 KKT conditions Slides, notes, video Quiz Scribe
Wed Feb 25 Duality uses and correspondences Slides, notes, video Quiz Scribe
Algorithms II: Second-order methods
Mon Mar 2 Newton's method Slides, notes, video Quiz Scribe
Wed Mar 4 Barrier method Slides, notes, video Quiz Scribe Hw 3 due (Thu)
Mon Mar 9 (Spring break, no class)
Wed Mar 11 (Spring break, no class)
Mon Mar 16 Primal-dual interior point methods I Slides, notes, video Quiz Scribe
Wed Mar 18 Primal-dual interior point methods II Slides, notes, video Quiz Scribe Hw 4 due (Thu)
Midterm
Mon Mar 23 Review Algorithms table, notes, video Scribe
Wed Mar 25 Midterm Midterm
Applications
Mon Mar 30 Case study: generalized lasso problems Slides, notes, video Quiz Scribe Project milestone 2 due
Wed Apr 1 Case study: generalized lasso problems (continued) Slides, notes, video Quiz Scribe
Special topics
Mon Apr 6 Dual methods and ADMM Slides, notes, video Quiz Scribe
Wed Apr 8 Coordinate descent Slides, notes, video Quiz
Mon Apr 13 Conditional gradient method Slides, notes, video Quiz Scribe
Wed Apr 15 Proximal and projected Newton methods Slides, notes, video Quiz Scribe
Mon Apr 20 Fast stochastic methods Notes, video Quiz Scribe Hw 5 due (Tue)
Wed Apr 22 Nonconvex? No problem! Slides, notes, video (No quiz) Scribe
Mon Apr 27 Little test Little test
Wed Apr 29 (Work on projects, no class)

Top

Assignments

All assignments are to be turned into Mallory Deptola, in 8001 GHC, unless specified otherwise. Top

Miscellaneous

Top