Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning

The concept of digital twin (DT), which has supported the optimization of physical system across various industries, now extends into federated digital twin (fDT) to manage complex, interconnected systems. Recent research and standardization efforts in DT have expanded their focus from optimizing in...

Full description

Saved in:
Bibliographic Details
Main Authors: Young-Jin Kim, Hanjin Kim, Beomsu Ha, Won-Tae Kim
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10843696/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832575571675054080
author Young-Jin Kim
Hanjin Kim
Beomsu Ha
Won-Tae Kim
author_facet Young-Jin Kim
Hanjin Kim
Beomsu Ha
Won-Tae Kim
author_sort Young-Jin Kim
collection DOAJ
description The concept of digital twin (DT), which has supported the optimization of physical system across various industries, now extends into federated digital twin (fDT) to manage complex, interconnected systems. Recent research and standardization efforts in DT have expanded their focus from optimizing individual physical twins to coordinating DT functionalities to optimize the services provided by set of physical twins. In fDT-based DT coordination, scheduling techniques that determine when to utilize available DTs efficiently are critical. However, the variable processing speeds of DT functionalities, as traceable from digital twins, present significant challenges in deriving optimal schedules. Traditional scheduling algorithms, which assume static processing speeds for machines (corresponding to DTs), encounter limitations in generating optimal schedules. These limitations are further exacerbated in scenarios that demand the flexibility and scalability inherent to fDT. To address this challenge, this paper proposes the fDT-DT scheduling framework. This framework effectively represents relationships among DTs using temporal heterogeneous graphs and generates flexible and scalable schedules by incorporating temporal graph neural networks and deep reinforcement learning to account for variable processing speeds. Experimental results demonstrate that, in scenarios where multiple DTs exhibit diverse speed profiles, the proposed approach improves makespan by 16.9% and reduces tardiness by 76.2%, demonstrating both flexibility and superior performance. Furthermore, even in untrained scenarios with increasing numbers of fDTs and DTs, it outperforms baseline algorithms on both metrics, confirming its scalability.
format Article
id doaj-art-2649b2d455774173a3f5cf5b6e332411
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-2649b2d455774173a3f5cf5b6e3324112025-01-31T23:04:42ZengIEEEIEEE Access2169-35362025-01-0113207632077710.1109/ACCESS.2025.353055810843696Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement LearningYoung-Jin Kim0Hanjin Kim1https://orcid.org/0000-0002-2436-3784Beomsu Ha2Won-Tae Kim3https://orcid.org/0000-0003-3426-3792Industrial AI Research Center, Chungbuk National University, Cheongju, Republic of KoreaDepartment of Computer Science and Engineering, Korea University of Technology and Education, Cheonan, Republic of KoreaDepartment of Computer Science and Engineering, Korea University of Technology and Education, Cheonan, Republic of KoreaDepartment of Computer Science and Engineering, Korea University of Technology and Education, Cheonan, Republic of KoreaThe concept of digital twin (DT), which has supported the optimization of physical system across various industries, now extends into federated digital twin (fDT) to manage complex, interconnected systems. Recent research and standardization efforts in DT have expanded their focus from optimizing individual physical twins to coordinating DT functionalities to optimize the services provided by set of physical twins. In fDT-based DT coordination, scheduling techniques that determine when to utilize available DTs efficiently are critical. However, the variable processing speeds of DT functionalities, as traceable from digital twins, present significant challenges in deriving optimal schedules. Traditional scheduling algorithms, which assume static processing speeds for machines (corresponding to DTs), encounter limitations in generating optimal schedules. These limitations are further exacerbated in scenarios that demand the flexibility and scalability inherent to fDT. To address this challenge, this paper proposes the fDT-DT scheduling framework. This framework effectively represents relationships among DTs using temporal heterogeneous graphs and generates flexible and scalable schedules by incorporating temporal graph neural networks and deep reinforcement learning to account for variable processing speeds. Experimental results demonstrate that, in scenarios where multiple DTs exhibit diverse speed profiles, the proposed approach improves makespan by 16.9% and reduces tardiness by 76.2%, demonstrating both flexibility and superior performance. Furthermore, even in untrained scenarios with increasing numbers of fDTs and DTs, it outperforms baseline algorithms on both metrics, confirming its scalability.https://ieeexplore.ieee.org/document/10843696/Federated digital twindigital twingraph neural networkdeep reinforcement learningjob-shop scheduling
spellingShingle Young-Jin Kim
Hanjin Kim
Beomsu Ha
Won-Tae Kim
Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning
IEEE Access
Federated digital twin
digital twin
graph neural network
deep reinforcement learning
job-shop scheduling
title Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning
title_full Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning
title_fullStr Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning
title_full_unstemmed Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning
title_short Federated Digital Twins: A Scheduling Approach Based on Temporal Graph Neural Network and Deep Reinforcement Learning
title_sort federated digital twins a scheduling approach based on temporal graph neural network and deep reinforcement learning
topic Federated digital twin
digital twin
graph neural network
deep reinforcement learning
job-shop scheduling
url https://ieeexplore.ieee.org/document/10843696/
work_keys_str_mv AT youngjinkim federateddigitaltwinsaschedulingapproachbasedontemporalgraphneuralnetworkanddeepreinforcementlearning
AT hanjinkim federateddigitaltwinsaschedulingapproachbasedontemporalgraphneuralnetworkanddeepreinforcementlearning
AT beomsuha federateddigitaltwinsaschedulingapproachbasedontemporalgraphneuralnetworkanddeepreinforcementlearning
AT wontaekim federateddigitaltwinsaschedulingapproachbasedontemporalgraphneuralnetworkanddeepreinforcementlearning