In this paper, a distributed algorithm is proposed to solve a kind of multi-objective optimization problem based on the alternating direction method of multipliers. Compared with the centralized algorithms, this algorithm does not need a central node. Therefore, it has the characteristics of low communication burden and high privacy. In addition, numerical experiments are provided to validate the effectiveness of the proposed algorithm.
KeywordsAlternating Direction Method of MultipliersDistributed AlgorithmMulti-Objective OptimizationMulti-Agent System
Wang, G.G., Cai, X., Cui, Z., Min, G. and Chen, J. (2020) High Performance Computing for Cyber Physical Social Systems by Using Evolutionary Multi-Objective Optimization Algorithm. IEEE Transactions on Emerging Topics in Computing, 8, 20-30. https://doi.org/10.1109/TETC.2017.2703784
Singh, D., Kumar, V., Vaishali, Z. and Kaur, M. (2020) Classification of COVID-19 patients from Chest CT Images Using Multi-Objective Differential Evolution-Based Convolutional Neural Networks. European Journal of Clinical Microbiology & Infectious Diseases, 39, 1379-1389. https://doi.org/10.1007/s10096-020-03901-z
Abualigah, L. and Diabat, A. (2021) A Novel Hybrid Antlion Optimization Algorithm for Multi-Objective Task Scheduling Problems in Cloud Computing Environments. Cluster Computing, 24, 205-223. https://doi.org/10.1007/s10586-020-03075-5
Wu, C.Y., Wang, J.Z., Chen, X.J., Du, P. and Yang, W.D. (2020) A Novel Hybrid System Based on Multi-Objective Optimization for Wind Speed Forecasting. Renewable Energy, 146, 149-165. https://doi.org/10.1016/j.renene.2019.04.157
Jahn, J. (2011) Vector Optimization: Theory, Applications, and Extensions. 2nd Edition, Springer, Heidelberg. https://doi.org/10.1007/978-3-642-17005-8
Fliege, J. and Svaiter, B.F. (2000) Steepest Descent Methods for Multicriteria Optimization. Mathematical Methods of Operations Research, 51, 479-494. https://doi.org/10.1007/s001860000043
Fliege, J., Graña Drummond, L.M. and Svaiter, B.F. (2009) Newtons Method for Multiobjective Optimization. SIAM Journal on Optimization, 20, 602-626. https://doi.org/10.1137/08071692X
Wang, J.H., Hu, Y.H., Yu, C.K.W., Li, C. and Yang, X.Q. (2019) Extended Newton Methods for Multiobjective Optimization: Majorizing Function Technique and Convergence Analysis. SIAM Journal on Optimization, 29, 2388-2421. https://doi.org/10.1137/18M1191737
Bonnel, H., Iusem, A.N. and Svaiter, B.F. (2005) Proximal Methods in Vector Optimization. SIAM Journal on Optimization, 15, 953-970. https://doi.org/10.1137/S1052623403429093
Bento, G.C., Ferreira, O.P. and Sousa, J.V.L. (2018) Proximal Point Method for a Special class of Nonconvex Multiobjective Optimization Functions. Optimization Letters, 12, 311-320. https://doi.org/10.1007/s11590-017-1114-0
Drummond, L.M.G. and Iusem, A.N. (2004) A Projected Gradient Method for Vector Optimization Problems. Computational Optimization and Applications, 28, 5-29. https://doi.org/10.1023/B:COAP.0000018877.86161.8b
Fazzio, N.S. and Schuverdt, M.L. (2018) Convergence Analysis of a Nonmonotone Projected Gradient Method for Multiobjective Optimization Problems. Optimization Letters, 13, 1365-1379. https://doi.org/10.1007/s11590-018-1353-8
Fukuda, E.H., Drummond, L.M.G. and Raupp, F.M.P. (2016) An External Penalty-Type Method for Multicriteria. TOP, 24, 493-513. https://doi.org/10.1007/s11750-015-0406-8
Deb, K., Pratap, A., Agarwal, S. and Meyarivan, T. (2002) A Fast and Elitist Multiobjective Genetic Algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation, 6, 182-197. https://doi.org/10.1109/4235.996017
Zhang, H., Zhou, A., Song, S., Zhang, Q., Gao, X. and Zhang, J. (2016) A Self-Organizing Multiobjective Evolutionary Algorithm. IEEE Transactions on Evolutionary Computation, 20, 792-806. https://doi.org/10.1109/TEVC.2016.2521868
Liang, J.J., Xu, W.W., Yue, C.T., Yu, K.J., Song, H., Crisalle, O.C. and Qu, B.Y. (2018) Multimodal Multiobjective Optimization with Differential Evolution. Swarm and Evolutionary Computation, 44, 1028-1059. https://doi.org/10.1016/j.swevo.2018.10.016
Yin, L.F. and Sun, Z.X. (2021) Multi-Layer Distributed Multi-Objective Consensus Algorithm for Multi-Objective Economic Dispatch of Large-Scale Multi-Area Interconnected Power Systems. Applied Energy, 300, Article ID: 117391. https://doi.org/10.1016/j.apenergy.2021.117391
Chen, S.X., Garcia, A. and Shahrampour S. (2022) On Distributed Nonconvex Optimization: Projected Subgradient Method for Weakly Convex Problems in Networks. IEEE Transactions on Automatic Control, 67, 662-675. https://doi.org/10.1109/TAC.2021.3056535
Droge, G., Kawashima, H. and Egerstedt, M.B. (2014) Continuous-Time Proportional-Integral Distributed Optimisation for Networked Systems. Journal of Control and Decision, 1, 191-213. https://doi.org/10.1109/TAC.2013.2278132
Gharesifard, B. and Cortés, J. (2014) Continuous-Time Distributed Convex Optimization on Weight-Balanced Digraphs. IEEE Transactions on Automatic Control, 59, 781-786. https://doi.org/10.1109/TAC.2013.2278132
Zhu, Y.N., Yu, W.W., Wen, G.H., Chen, G.R. and Ren, W. (2019) Continuous-time Distributed Subgradient Algorithm for Convex Optimization with General Constraints. IEEE Transactions on Automatic Control, 64, 1694-1701. https://doi.org/10.1109/TAC.2018.2852602
Zhu, W. and Tian, H.B. (2021) Distributed Convex Optimization via Proportional-Integral-Differential Algorithm. Measurement and Control. https://doi.org/10.1177/00202940211029332
Nedic, A. and Ozdaglar, A. (2009) Distributed Subgradient Methods for Multi-Agent Optimization. IEEE Transactions on Automatic Control, 54, 48-61. https://doi.org/10.1016/j.automatica.2017.06.011
Xi, C. and Khan, U.A. (2017) Distributed Subgradient Projection Algorithm over Directed Graphs. IEEE Transactions on Automatic Control, 62, 3986-3992. https://doi.org/10.1016/j.automatica.2017.06.011
Liu, S., Zhang, Z.R. and Xie, L.H. (2017) Convergence Rate Analysis of Distributed Optimization with Projected Subgradient Algorithm. Automatica, 83, 162-169. https://doi.org/10.1016/j.automatica.2017.06.011
Jakovetić, D., Xavier, J. and Moura, J.M.F. (2011) Cooperative Convex Optimization in Networked Systems: Augmented Lagrangian Algorithms with Directed Gossip Communication. IEEE Transactions on Signal Processing, 59, 3889-3902. https://doi.org/10.1109/TSP.2011.2146776
Boyd, S., Parikh, N., Chu, E., Peleato, B. and Eckstein, J. (2010) Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers. Foundations and Trends ® in Machine Learning, 3, 1-122. https://doi.org/10.1561/2200000016
Zhang, R. and Kwok, J.T. (2014) Asynchronous Distributed ADMM for Consensus Optimization. Proceedings of the 31st International Conference on Machine Learning, Beijing, 21-26 June 2014, 3689-3697.
Wei, E. and Ozdaglar, A. (2012) Distributed Alternating Direction Method of Multipliers. Proceedings of the 2012 IEEE 51st IEEE Conference on Decision and Control, Maui, 10-13 December 2011, 5445-5450. https://doi.org/10.1109/CDC.2012.6425904
Yan, J.Q., Guo, F.H., Wen, C.Y. and Li, G.Q. (2020) Parallel Alternating Direction Method of Multipliers. Information Sciences, 507, 185-196. https://doi.org/10.1016/j.ins.2019.08.039
Shi, W., Ling, Q., Yuan, K., Wu, G. and Yin, W. (2014) On the Linear Convergence of the ADMM in Decentralized Consensus Optimization. IEEE Transactions on Signal Processing, 62, 1750-1761. https://doi.org/10.1109/TSP.2014.2304432
Hong, M., Davood, H. and Zhao, M. (2017) Prox-PDA: The Proximal Primal-Dual Algorithm for Fast Distributed Nonconvex Optimization and Learning over Networks. Proceedings of the 34th International Conference on Machine Learning, Sydney, 6-11 August 2017, 2402-2433.
Wang, Y., Yin, W. and Zeng, J. (2015) Global Convergence of ADMM in Nonconvex Nonsmooth Optimization. Journal of Scientific Computing, 78, 26-93. https://doi.org/10.1007/s10915-018-0757-z
Simonetto, A. and Leus, G. (2014) Distributed Maximum Likelihood Sensor Network Localization. IEEE Transactions on Signal Processing, 62, 1424-1437. https://doi.org/10.1109/TSP.2014.2302746