Lab Home | Phone | Search
Center for Nonlinear Studies  Center for Nonlinear Studies
 Home 
 People 
 Current 
 Affiliates 
 Visitors 
 Students 
 Research 
 ICAM-LANL 
 Publications 
 Conferences 
 Workshops 
 Sponsorship 
 Talks 
 Colloquia 
 Colloquia Archive 
 Seminars 
 Postdoc Seminars Archive 
 Quantum Lunch 
 Quantum Lunch Archive 
 CMS Colloquia 
 Q-Mat Seminars 
 Q-Mat Seminars Archive 
 P/T Colloquia 
 Archive 
 Kac Lectures 
 Kac Fellows 
 Dist. Quant. Lecture 
 Ulam Scholar 
 Colloquia 
 
 Jobs 
 Postdocs 
 CNLS Fellowship Application 
 Students 
 Student Program 
 Visitors 
 Description 
 Past Visitors 
 Services 
 General 
 
 History of CNLS 
 
 Maps, Directions 
 CNLS Office 
 T-Division 
 LANL 
 
Thursday, June 01, 2017
1:00 PM - 2:00 PM
CNLS Conference Room (TA-3, Bldg 1690)

Seminar

Fast Distributed Second Order Method for Large Scale Optimization

Rasul Tutunov
University of Pennsylvania

We propose a distributed second order method for general consensus. Our approach is the fastest in literature so-far as it outperforms state-of-the-art methods, including ADMM, by significant margins. This is achieved by exploiting the sparsity pattern of the dual Hessian and transforming the problem to a one of efficiently solving a sequence of symmetric diagonally dominant system of equations. For the latter problem we suggest two novel techniques: fully distributed and mixed. For the first algorithm we exploit the extremal properties of Chebyshev polynomials to achieve fast performance. The mixed algorithm is based on distributed sparsification approach and exhibits linear time complexity. We validate our guarantee for general consensus both theoretically and empirically. On the theory side, we prove that similar to exact Newton, our algorithm exhibits superlinear convergence within a neighborhood of the optimal solution. Empirically, we demonstrate the superiority of this new method on a variety of machine learning problems and show that our improvements arrive at low communication overhead between processors.

Host: Michael Chertkov