Communication-Censored ADMM for Decentralized Consensus Optimization

You are here

Top Reasons to Join SPS Today!

1. IEEE Signal Processing Magazine
2. Signal Processing Digital Library*
3. Inside Signal Processing Newsletter
4. SPS Resource Center
5. Career advancement & recognition
6. Discounts on conferences and publications
7. Professional networking
8. Communities for students, young professionals, and women
9. Volunteer opportunities
10. Coming soon! PDH/CEU credits
Click here to learn more.

Communication-Censored ADMM for Decentralized Consensus Optimization

By: 
Yaohua Liu; Wei Xu; Gang Wu; Zhi Tian; Qing Ling

In this paper, we devise a communication-efficient decentralized algorithm, named as communication-censored alternating direction method of multipliers (ADMM) (COCA), to solve a convex consensus optimization problem defined over a network. Similar to popular decentralized consensus optimization algorithms such as ADMM, at every iteration of COCA, a node exchanges its local variable with neighbors, and then updates its local variable according to the received neighboring variables and its local cost function. A different feature of COCA is that a node is not allowed to transmit its local variable to neighbors, if this variable is not sufficiently different to the previously transmitted one. The sufficiency of the difference is evaluated by a properly designed censoring function. Though this censoring strategy may slow down the optimization process, it effectively reduces the communication cost. We prove that when the censoring function is properly chosen, COCA converges to an optimal solution of the convex consensus optimization problem. Furthermore, if the local cost functions are strongly convex, COCA has a fast linear convergence rate. Numerical experiments demonstrate that, given a target solution accuracy, COCA is able to significantly reduce the overall communication cost compared to existing algorithms including ADMM, and hence fits for applications where network communication is a bottleneck.

SPS on Twitter

  • Registration is now live for the 2020 IEEE 6th World Forum on Internet of Things! Meet attendees from industry, the… https://t.co/1T7vQhAazS
  • Early bird registration for ends on Monday, 24 February. Register today and save, and save even more with… https://t.co/dzlSXdN4y8
  • The IEEE Journal of Selected Topics in Signal Processing is now accepting original manuscripts for a Special Issue… https://t.co/mXKh41of5A
  • Join us on Tuesday, 25 February for a new webinar, “Enabling Identity-Based Integrity Auditing and Data Sharing Wit… https://t.co/rfpjVkEv09
  • The 2020 IEEE International Conference on Autonomous Systems will take place in Montréal on 12-14 August 2020 and w… https://t.co/ePFEWYagwP

SPS Videos


Signal Processing in Home Assistants

 


Multimedia Forensics


Careers in Signal Processing             

 


Under the Radar