Division-selection transfer learning for prediction based dynamic multi-objective optimization

Abstract Dynamic multi-objective optimization problems (DMOPs) are challenging as they require capturing the Pareto optimal front (POF) and Pareto optimal set (POS) during the optimization process. In recent years, transfer learning (TL) has emerged the empirical knowledge and is an effective approa...

Full description

Saved in:
Bibliographic Details
Main Authors: Hongye Li, Fan Liang, Yulu Liu, Quanheng Zheng, Kunru Guo
Format: Article
Language:English
Published: Springer 2024-12-01
Series:Complex & Intelligent Systems
Subjects:
Online Access:https://doi.org/10.1007/s40747-024-01656-0
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832571200468942848
author Hongye Li
Fan Liang
Yulu Liu
Quanheng Zheng
Kunru Guo
author_facet Hongye Li
Fan Liang
Yulu Liu
Quanheng Zheng
Kunru Guo
author_sort Hongye Li
collection DOAJ
description Abstract Dynamic multi-objective optimization problems (DMOPs) are challenging as they require capturing the Pareto optimal front (POF) and Pareto optimal set (POS) during the optimization process. In recent years, transfer learning (TL) has emerged the empirical knowledge and is an effective approach to solve DMOPs. However, negative transfer can occur when the transfer method is not suitable for the transfer task. It may deviate the search path and seriously reduce the efficiency, so how to reduce the occurrence of negative transfer to save the running time of dynamic multi-objective evolutionary algorithm (DMOEA) is an important issue to be addressed. A division-selection transfer learning evolutionary algorithm for dynamic multi-objective optimization (DST-DMOEA) is designed towards this aim. Specifically, individuals with high Spearman correlation are relatively stable in different environments, selecting them to train the Support Vector Regression (SVR) model ensures a more accurate capture of solution features, predicting the objective values of historical solutions based on the model, and thus divide historical solutions into elite and non-elite solutions. Subsequently, for the elite solutions, individual TL that incorporates local information for optimization and transfer is used, while the non-elite solutions are handled with manifold TL method to obtain the overall data distribution and understand the internal structure. Then, merge the predicted individuals generated by two parts of TL will constitute as the initial population in the optimization process. Compared with other algorithms, the initial solution of DST-DMOEA is closer to the real POF, effectively reducing negative transfer. In addition, in 51 test instances, DST-DMOEA has shown superior performance in over 30 instances.
format Article
id doaj-art-d3759939509141acbba39e4c4731048c
institution Kabale University
issn 2199-4536
2198-6053
language English
publishDate 2024-12-01
publisher Springer
record_format Article
series Complex & Intelligent Systems
spelling doaj-art-d3759939509141acbba39e4c4731048c2025-02-02T12:50:21ZengSpringerComplex & Intelligent Systems2199-45362198-60532024-12-0111112110.1007/s40747-024-01656-0Division-selection transfer learning for prediction based dynamic multi-objective optimizationHongye Li0Fan Liang1Yulu Liu2Quanheng Zheng3Kunru Guo4School of Computer Science and Technology, Xi’an University of Posts and TelecommunicationsSchool of Computer Science and Technology, Xi’an University of Posts and TelecommunicationsSchool of Computer Science and Technology, Xi’an University of Posts and TelecommunicationsSchool of Computer Science and Technology, Xi’an University of Posts and TelecommunicationsSchool of Computer Science and Technology, Xi’an University of Posts and TelecommunicationsAbstract Dynamic multi-objective optimization problems (DMOPs) are challenging as they require capturing the Pareto optimal front (POF) and Pareto optimal set (POS) during the optimization process. In recent years, transfer learning (TL) has emerged the empirical knowledge and is an effective approach to solve DMOPs. However, negative transfer can occur when the transfer method is not suitable for the transfer task. It may deviate the search path and seriously reduce the efficiency, so how to reduce the occurrence of negative transfer to save the running time of dynamic multi-objective evolutionary algorithm (DMOEA) is an important issue to be addressed. A division-selection transfer learning evolutionary algorithm for dynamic multi-objective optimization (DST-DMOEA) is designed towards this aim. Specifically, individuals with high Spearman correlation are relatively stable in different environments, selecting them to train the Support Vector Regression (SVR) model ensures a more accurate capture of solution features, predicting the objective values of historical solutions based on the model, and thus divide historical solutions into elite and non-elite solutions. Subsequently, for the elite solutions, individual TL that incorporates local information for optimization and transfer is used, while the non-elite solutions are handled with manifold TL method to obtain the overall data distribution and understand the internal structure. Then, merge the predicted individuals generated by two parts of TL will constitute as the initial population in the optimization process. Compared with other algorithms, the initial solution of DST-DMOEA is closer to the real POF, effectively reducing negative transfer. In addition, in 51 test instances, DST-DMOEA has shown superior performance in over 30 instances.https://doi.org/10.1007/s40747-024-01656-0Dynamic multi-objective optimizationDivision-selectionExternal samplingTransfer learningNegative transferEvolutionary algorithms
spellingShingle Hongye Li
Fan Liang
Yulu Liu
Quanheng Zheng
Kunru Guo
Division-selection transfer learning for prediction based dynamic multi-objective optimization
Complex & Intelligent Systems
Dynamic multi-objective optimization
Division-selection
External sampling
Transfer learning
Negative transfer
Evolutionary algorithms
title Division-selection transfer learning for prediction based dynamic multi-objective optimization
title_full Division-selection transfer learning for prediction based dynamic multi-objective optimization
title_fullStr Division-selection transfer learning for prediction based dynamic multi-objective optimization
title_full_unstemmed Division-selection transfer learning for prediction based dynamic multi-objective optimization
title_short Division-selection transfer learning for prediction based dynamic multi-objective optimization
title_sort division selection transfer learning for prediction based dynamic multi objective optimization
topic Dynamic multi-objective optimization
Division-selection
External sampling
Transfer learning
Negative transfer
Evolutionary algorithms
url https://doi.org/10.1007/s40747-024-01656-0
work_keys_str_mv AT hongyeli divisionselectiontransferlearningforpredictionbaseddynamicmultiobjectiveoptimization
AT fanliang divisionselectiontransferlearningforpredictionbaseddynamicmultiobjectiveoptimization
AT yululiu divisionselectiontransferlearningforpredictionbaseddynamicmultiobjectiveoptimization
AT quanhengzheng divisionselectiontransferlearningforpredictionbaseddynamicmultiobjectiveoptimization
AT kunruguo divisionselectiontransferlearningforpredictionbaseddynamicmultiobjectiveoptimization