Reinforcement Learning Based Acceptance Criteria for Metaheuristic Algorithms

Abstract This paper proposes novel reinforcement learning-based acceptance criteria for metaheuristic algorithms. We develop Q-learning and Deep Q-learning-based acceptance criteria and integrate them into simulated annealing (SA) and artificial bee colony (ABC) algorithms. Also, we design two versi...

Full description

Saved in:
Bibliographic Details
Main Authors: Oğuzhan Ahmet Arık, Gülhan Toğa, Berrin Atalay
Format: Article
Language:English
Published: Springer 2025-08-01
Series:International Journal of Computational Intelligence Systems
Subjects:
Online Access:https://doi.org/10.1007/s44196-025-00924-2
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract This paper proposes novel reinforcement learning-based acceptance criteria for metaheuristic algorithms. We develop Q-learning and Deep Q-learning-based acceptance criteria and integrate them into simulated annealing (SA) and artificial bee colony (ABC) algorithms. Also, we design two versions of these novel acceptance criteria: the online version and the offline version of Q-learning and deep Q-learning based acceptance criteria. The online version starts to train itself and to make decisions to accept or reject the candidate solution with the start of the metaheuristic. The offline version uses a trained and well-tuned Q-learning and deep Q-learning based acceptance criteria to make accept/reject decisions. Our experimental study compares our proposed acceptance criteria with existing ones, such as fuzzy rule-based acceptance (FRBA) and simulated annealing-like acceptance (SALA) criteria. The experiment reveals that metaheuristics with deep Q-learning-based offline acceptance criteria outperform metaheuristics with existing acceptance criteria and other variants in this study.
ISSN:1875-6883