Dynamic Watermarking for Finite Markov Decision Processes
Dynamic watermarking is an active intrusion detection technique that can potentially detect replay attacks, spoofing attacks, and deception attacks in the feedback channel for control systems. In this paper, we develop a novel dynamic watermarking algorithm for finite-state finite-action Markov deci...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Open Journal of Control Systems |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10824908/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832575610298302464 |
|---|---|
| author | Jiacheng Tang Jiguo Song Abhishek Gupta |
| author_facet | Jiacheng Tang Jiguo Song Abhishek Gupta |
| author_sort | Jiacheng Tang |
| collection | DOAJ |
| description | Dynamic watermarking is an active intrusion detection technique that can potentially detect replay attacks, spoofing attacks, and deception attacks in the feedback channel for control systems. In this paper, we develop a novel dynamic watermarking algorithm for finite-state finite-action Markov decision processes. We derive a lower bound on the mean time between false alarms and an upper bound on the mean delay between the time an attack occurs and when it is detected. We further compute the sensitivity of the performance of the control system as a function of the watermark. We demonstrate the effectiveness of the proposed dynamic watermarking algorithm by detecting a spoofing attack in a sensor network system. |
| format | Article |
| id | doaj-art-b201a40f600348dba7cf68d2d97043ca |
| institution | Kabale University |
| issn | 2694-085X |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Open Journal of Control Systems |
| spelling | doaj-art-b201a40f600348dba7cf68d2d97043ca2025-01-31T23:05:29ZengIEEEIEEE Open Journal of Control Systems2694-085X2025-01-014415210.1109/OJCSYS.2025.352600310824908Dynamic Watermarking for Finite Markov Decision ProcessesJiacheng Tang0https://orcid.org/0000-0003-2103-6953Jiguo Song1https://orcid.org/0000-0003-1028-7423Abhishek Gupta2https://orcid.org/0000-0003-1117-325XGE Global Research, Niskayuna, NY, USAFord Motor Company, Dearborn, MI, USAOhio State University, Columbus, OH, USADynamic watermarking is an active intrusion detection technique that can potentially detect replay attacks, spoofing attacks, and deception attacks in the feedback channel for control systems. In this paper, we develop a novel dynamic watermarking algorithm for finite-state finite-action Markov decision processes. We derive a lower bound on the mean time between false alarms and an upper bound on the mean delay between the time an attack occurs and when it is detected. We further compute the sensitivity of the performance of the control system as a function of the watermark. We demonstrate the effectiveness of the proposed dynamic watermarking algorithm by detecting a spoofing attack in a sensor network system.https://ieeexplore.ieee.org/document/10824908/Anomaly detectioncyberattack detectiondynamic watermarking |
| spellingShingle | Jiacheng Tang Jiguo Song Abhishek Gupta Dynamic Watermarking for Finite Markov Decision Processes IEEE Open Journal of Control Systems Anomaly detection cyberattack detection dynamic watermarking |
| title | Dynamic Watermarking for Finite Markov Decision Processes |
| title_full | Dynamic Watermarking for Finite Markov Decision Processes |
| title_fullStr | Dynamic Watermarking for Finite Markov Decision Processes |
| title_full_unstemmed | Dynamic Watermarking for Finite Markov Decision Processes |
| title_short | Dynamic Watermarking for Finite Markov Decision Processes |
| title_sort | dynamic watermarking for finite markov decision processes |
| topic | Anomaly detection cyberattack detection dynamic watermarking |
| url | https://ieeexplore.ieee.org/document/10824908/ |
| work_keys_str_mv | AT jiachengtang dynamicwatermarkingforfinitemarkovdecisionprocesses AT jiguosong dynamicwatermarkingforfinitemarkovdecisionprocesses AT abhishekgupta dynamicwatermarkingforfinitemarkovdecisionprocesses |