Q‐scheduler: A temperature and energy‐aware deep Q‐learning technique to schedule tasks in real‐time multiprocessor embedded systems

Abstract Reducing energy consumption under processors' temperature constraints has recently become a pressing issue in real‐time multiprocessor systems on chips (MPSoCs). The high temperature of processors affects the power and reliability of the MPSoC. Low energy consumption is necessary for r...

Full description

Saved in:
Bibliographic Details
Main Authors: Mahsa Mohammadi, Hakem Beitollahi
Format: Article
Language:English
Published: Wiley 2022-07-01
Series:IET Computers & Digital Techniques
Online Access:https://doi.org/10.1049/cdt2.12044
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832547371276304384
author Mahsa Mohammadi
Hakem Beitollahi
author_facet Mahsa Mohammadi
Hakem Beitollahi
author_sort Mahsa Mohammadi
collection DOAJ
description Abstract Reducing energy consumption under processors' temperature constraints has recently become a pressing issue in real‐time multiprocessor systems on chips (MPSoCs). The high temperature of processors affects the power and reliability of the MPSoC. Low energy consumption is necessary for real‐time embedded systems, as most of them are portable devices. Efficient task mapping on processors has a significant impact on reducing energy consumption and the thermal profile of processors. Several state‐of‐the‐art techniques have recently been proposed for this issue. This paper proposes Q‐scheduler, a novel technique based on the deep Q‐learning technology, to dispatch tasks between processors in a real‐time MPSoC. Thousands of simulated tasks train Q‐scheduler offline to reduce the system's power consumption under temperature constraints of processors. The trained Q‐scheduler dispatches real tasks in a real‐time MPSoC online while also being trained regularly online. Q‐scheduler dispatches multiple tasks in the system simultaneously with a single process; the effectiveness of this ability is significant, especially in a harmonic real‐time system. Experimental results illustrate that Q‐scheduler reduces energy consumption and temperature of processors on average by 15% and 10%, respectively, compared to previous state‐of‐the‐art techniques.
format Article
id doaj-art-81be5791667f4778b14ea09dbdff03e8
institution Kabale University
issn 1751-8601
1751-861X
language English
publishDate 2022-07-01
publisher Wiley
record_format Article
series IET Computers & Digital Techniques
spelling doaj-art-81be5791667f4778b14ea09dbdff03e82025-02-03T06:45:05ZengWileyIET Computers & Digital Techniques1751-86011751-861X2022-07-0116412514010.1049/cdt2.12044Q‐scheduler: A temperature and energy‐aware deep Q‐learning technique to schedule tasks in real‐time multiprocessor embedded systemsMahsa Mohammadi0Hakem Beitollahi1School of Computer Engineering Iran University of Science and Technology, IUST Tehran IranSchool of Computer Engineering Iran University of Science and Technology, IUST Tehran IranAbstract Reducing energy consumption under processors' temperature constraints has recently become a pressing issue in real‐time multiprocessor systems on chips (MPSoCs). The high temperature of processors affects the power and reliability of the MPSoC. Low energy consumption is necessary for real‐time embedded systems, as most of them are portable devices. Efficient task mapping on processors has a significant impact on reducing energy consumption and the thermal profile of processors. Several state‐of‐the‐art techniques have recently been proposed for this issue. This paper proposes Q‐scheduler, a novel technique based on the deep Q‐learning technology, to dispatch tasks between processors in a real‐time MPSoC. Thousands of simulated tasks train Q‐scheduler offline to reduce the system's power consumption under temperature constraints of processors. The trained Q‐scheduler dispatches real tasks in a real‐time MPSoC online while also being trained regularly online. Q‐scheduler dispatches multiple tasks in the system simultaneously with a single process; the effectiveness of this ability is significant, especially in a harmonic real‐time system. Experimental results illustrate that Q‐scheduler reduces energy consumption and temperature of processors on average by 15% and 10%, respectively, compared to previous state‐of‐the‐art techniques.https://doi.org/10.1049/cdt2.12044
spellingShingle Mahsa Mohammadi
Hakem Beitollahi
Q‐scheduler: A temperature and energy‐aware deep Q‐learning technique to schedule tasks in real‐time multiprocessor embedded systems
IET Computers & Digital Techniques
title Q‐scheduler: A temperature and energy‐aware deep Q‐learning technique to schedule tasks in real‐time multiprocessor embedded systems
title_full Q‐scheduler: A temperature and energy‐aware deep Q‐learning technique to schedule tasks in real‐time multiprocessor embedded systems
title_fullStr Q‐scheduler: A temperature and energy‐aware deep Q‐learning technique to schedule tasks in real‐time multiprocessor embedded systems
title_full_unstemmed Q‐scheduler: A temperature and energy‐aware deep Q‐learning technique to schedule tasks in real‐time multiprocessor embedded systems
title_short Q‐scheduler: A temperature and energy‐aware deep Q‐learning technique to schedule tasks in real‐time multiprocessor embedded systems
title_sort q scheduler a temperature and energy aware deep q learning technique to schedule tasks in real time multiprocessor embedded systems
url https://doi.org/10.1049/cdt2.12044
work_keys_str_mv AT mahsamohammadi qscheduleratemperatureandenergyawaredeepqlearningtechniquetoscheduletasksinrealtimemultiprocessorembeddedsystems
AT hakembeitollahi qscheduleratemperatureandenergyawaredeepqlearningtechniquetoscheduletasksinrealtimemultiprocessorembeddedsystems