Design of Control System of Once-Through Steam Generator Based on Proximal Policy Optimization Algorithm
Because of the characteristics of the small water volume of OTSG, it is hard to control the outlet steam pressure when the load is changed or disturbed. This study is devoted to the control of the once-through steam generator (OTSG). A double-layer controller based on the PPO algorithm is proposed t...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2022-01-01
|
| Series: | Science and Technology of Nuclear Installations |
| Online Access: | http://dx.doi.org/10.1155/2022/2941705 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832553624873467904 |
|---|---|
| author | Cheng Li Ren Yu Wenmin Yu Tianshu Wang |
| author_facet | Cheng Li Ren Yu Wenmin Yu Tianshu Wang |
| author_sort | Cheng Li |
| collection | DOAJ |
| description | Because of the characteristics of the small water volume of OTSG, it is hard to control the outlet steam pressure when the load is changed or disturbed. This study is devoted to the control of the once-through steam generator (OTSG). A double-layer controller based on the PPO algorithm is proposed to control the outlet steam pressure of OTSG. The bottom layer is the PID controller; it directly regulates the OTSG feed water valve and then controls the steam pressure. The top layer of the controller is the agent based on the PPO algorithm, which is responsible for optimizing the parameters of the PID in real time to obtain better control performance. The agent chooses PID parameters as actions to the environment, and then, the reward value is obtained through the reward function of the environment which enables online learning of the agent. Compared with the PID controller, the simulation experiment result shows that the method not only has a good control performance but also has a good anti-interference ability. |
| format | Article |
| id | doaj-art-a47419cab6f94602924fe9151e80f3c5 |
| institution | Kabale University |
| issn | 1687-6083 |
| language | English |
| publishDate | 2022-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Science and Technology of Nuclear Installations |
| spelling | doaj-art-a47419cab6f94602924fe9151e80f3c52025-02-03T05:53:34ZengWileyScience and Technology of Nuclear Installations1687-60832022-01-01202210.1155/2022/2941705Design of Control System of Once-Through Steam Generator Based on Proximal Policy Optimization AlgorithmCheng Li0Ren Yu1Wenmin Yu2Tianshu Wang3Naval University of EngineeringNaval University of EngineeringNaval University of EngineeringNaval University of EngineeringBecause of the characteristics of the small water volume of OTSG, it is hard to control the outlet steam pressure when the load is changed or disturbed. This study is devoted to the control of the once-through steam generator (OTSG). A double-layer controller based on the PPO algorithm is proposed to control the outlet steam pressure of OTSG. The bottom layer is the PID controller; it directly regulates the OTSG feed water valve and then controls the steam pressure. The top layer of the controller is the agent based on the PPO algorithm, which is responsible for optimizing the parameters of the PID in real time to obtain better control performance. The agent chooses PID parameters as actions to the environment, and then, the reward value is obtained through the reward function of the environment which enables online learning of the agent. Compared with the PID controller, the simulation experiment result shows that the method not only has a good control performance but also has a good anti-interference ability.http://dx.doi.org/10.1155/2022/2941705 |
| spellingShingle | Cheng Li Ren Yu Wenmin Yu Tianshu Wang Design of Control System of Once-Through Steam Generator Based on Proximal Policy Optimization Algorithm Science and Technology of Nuclear Installations |
| title | Design of Control System of Once-Through Steam Generator Based on Proximal Policy Optimization Algorithm |
| title_full | Design of Control System of Once-Through Steam Generator Based on Proximal Policy Optimization Algorithm |
| title_fullStr | Design of Control System of Once-Through Steam Generator Based on Proximal Policy Optimization Algorithm |
| title_full_unstemmed | Design of Control System of Once-Through Steam Generator Based on Proximal Policy Optimization Algorithm |
| title_short | Design of Control System of Once-Through Steam Generator Based on Proximal Policy Optimization Algorithm |
| title_sort | design of control system of once through steam generator based on proximal policy optimization algorithm |
| url | http://dx.doi.org/10.1155/2022/2941705 |
| work_keys_str_mv | AT chengli designofcontrolsystemofoncethroughsteamgeneratorbasedonproximalpolicyoptimizationalgorithm AT renyu designofcontrolsystemofoncethroughsteamgeneratorbasedonproximalpolicyoptimizationalgorithm AT wenminyu designofcontrolsystemofoncethroughsteamgeneratorbasedonproximalpolicyoptimizationalgorithm AT tianshuwang designofcontrolsystemofoncethroughsteamgeneratorbasedonproximalpolicyoptimizationalgorithm |