Creating and sharing knowledge for telecommunications

Adaptive ADMM with Spectral Penalty Parameter Selection

Xu, Z. ; Figueiredo, M. A. T. ; Goldstein, T.

Adaptive ADMM with Spectral Penalty Parameter Selection, Proc International Conf. on Artificial Intelligence and Statistics - AISTATS, Fort Lauderdale, United States, Vol. N/A, pp. - - -, April, 2017.

Digital Object Identifier:

Download Full text PDF ( 544 KBs)


The alternating direction method of multipliers (ADMM) is a versatile tool for solving a wide range of constrained optimization problems. However, its performance is highly sensitive to a penalty parameter, making ADMM often unreliable and hard to automate for a non-expert user. We tackle this weakness of ADMM by proposing a method that adaptively tunes the penalty parameter to achieve fast convergence. The resulting adaptive ADMM (AADMM) algorithm, inspired by the successful Barzilai-Borwein spectral method for gradient descent, yields fast convergence and relative insensitivity to the initial stepsize and problem scaling.