Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning
The concept of digital twin (DT), which has supported the optimization of physical system across various industries, now extends into federated digital twin (fDT) to manage complex, interconnected systems. Recent research and standardization efforts in DT have expanded their focus from optimizing in...
Saved in:
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2025-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/10843696/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1832575571675054080 |
---|---|
author | Young-Jin Kim Hanjin Kim Beomsu Ha Won-Tae Kim |
author_facet | Young-Jin Kim Hanjin Kim Beomsu Ha Won-Tae Kim |
author_sort | Young-Jin Kim |
collection | DOAJ |
description | The concept of digital twin (DT), which has supported the optimization of physical system across various industries, now extends into federated digital twin (fDT) to manage complex, interconnected systems. Recent research and standardization efforts in DT have expanded their focus from optimizing individual physical twins to coordinating DT functionalities to optimize the services provided by set of physical twins. In fDT-based DT coordination, scheduling techniques that determine when to utilize available DTs efficiently are critical. However, the variable processing speeds of DT functionalities, as traceable from digital twins, present significant challenges in deriving optimal schedules. Traditional scheduling algorithms, which assume static processing speeds for machines (corresponding to DTs), encounter limitations in generating optimal schedules. These limitations are further exacerbated in scenarios that demand the flexibility and scalability inherent to fDT. To address this challenge, this paper proposes the fDT-DT scheduling framework. This framework effectively represents relationships among DTs using temporal heterogeneous graphs and generates flexible and scalable schedules by incorporating temporal graph neural networks and deep reinforcement learning to account for variable processing speeds. Experimental results demonstrate that, in scenarios where multiple DTs exhibit diverse speed profiles, the proposed approach improves makespan by 16.9% and reduces tardiness by 76.2%, demonstrating both flexibility and superior performance. Furthermore, even in untrained scenarios with increasing numbers of fDTs and DTs, it outperforms baseline algorithms on both metrics, confirming its scalability. |
format | Article |
id | doaj-art-2649b2d455774173a3f5cf5b6e332411 |
institution | Kabale University |
issn | 2169-3536 |
language | English |
publishDate | 2025-01-01 |
publisher | IEEE |
record_format | Article |
series | IEEE Access |
spelling | doaj-art-2649b2d455774173a3f5cf5b6e3324112025-01-31T23:04:42ZengIEEEIEEE Access2169-35362025-01-0113207632077710.1109/ACCESS.2025.353055810843696Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement LearningYoung-Jin Kim0Hanjin Kim1https://orcid.org/0000-0002-2436-3784Beomsu Ha2Won-Tae Kim3https://orcid.org/0000-0003-3426-3792Industrial AI Research Center, Chungbuk National University, Cheongju, Republic of KoreaDepartment of Computer Science and Engineering, Korea University of Technology and Education, Cheonan, Republic of KoreaDepartment of Computer Science and Engineering, Korea University of Technology and Education, Cheonan, Republic of KoreaDepartment of Computer Science and Engineering, Korea University of Technology and Education, Cheonan, Republic of KoreaThe concept of digital twin (DT), which has supported the optimization of physical system across various industries, now extends into federated digital twin (fDT) to manage complex, interconnected systems. Recent research and standardization efforts in DT have expanded their focus from optimizing individual physical twins to coordinating DT functionalities to optimize the services provided by set of physical twins. In fDT-based DT coordination, scheduling techniques that determine when to utilize available DTs efficiently are critical. However, the variable processing speeds of DT functionalities, as traceable from digital twins, present significant challenges in deriving optimal schedules. Traditional scheduling algorithms, which assume static processing speeds for machines (corresponding to DTs), encounter limitations in generating optimal schedules. These limitations are further exacerbated in scenarios that demand the flexibility and scalability inherent to fDT. To address this challenge, this paper proposes the fDT-DT scheduling framework. This framework effectively represents relationships among DTs using temporal heterogeneous graphs and generates flexible and scalable schedules by incorporating temporal graph neural networks and deep reinforcement learning to account for variable processing speeds. Experimental results demonstrate that, in scenarios where multiple DTs exhibit diverse speed profiles, the proposed approach improves makespan by 16.9% and reduces tardiness by 76.2%, demonstrating both flexibility and superior performance. Furthermore, even in untrained scenarios with increasing numbers of fDTs and DTs, it outperforms baseline algorithms on both metrics, confirming its scalability.https://ieeexplore.ieee.org/document/10843696/Federated digital twindigital twingraph neural networkdeep reinforcement learningjob-shop scheduling |
spellingShingle | Young-Jin Kim Hanjin Kim Beomsu Ha Won-Tae Kim Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning IEEE Access Federated digital twin digital twin graph neural network deep reinforcement learning job-shop scheduling |
title | Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning |
title_full | Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning |
title_fullStr | Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning |
title_full_unstemmed | Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning |
title_short | Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning |
title_sort | federated digital twins a scheduling approach based on temporal graph neural network and deep reinforcement learning |
topic | Federated digital twin digital twin graph neural network deep reinforcement learning job-shop scheduling |
url | https://ieeexplore.ieee.org/document/10843696/ |
work_keys_str_mv | AT youngjinkim federateddigitaltwinsaschedulingapproachbasedontemporalgraphneuralnetworkanddeepreinforcementlearning AT hanjinkim federateddigitaltwinsaschedulingapproachbasedontemporalgraphneuralnetworkanddeepreinforcementlearning AT beomsuha federateddigitaltwinsaschedulingapproachbasedontemporalgraphneuralnetworkanddeepreinforcementlearning AT wontaekim federateddigitaltwinsaschedulingapproachbasedontemporalgraphneuralnetworkanddeepreinforcementlearning |