AP-IO: Asynchronous Pipeline I/O for Hiding Periodic Output Cost in CFD Simulation
Computational fluid dynamics (CFD) simulation often needs to periodically output intermediate results to files in the form of snapshots for visualization or restart, which seriously impacts the performance. In this paper, we present asynchronous pipeline I/O (AP-IO) optimization scheme for the perio...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2014-01-01
|
| Series: | The Scientific World Journal |
| Online Access: | http://dx.doi.org/10.1155/2014/273807 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832568351000363008 |
|---|---|
| author | Ren Xiaoguang Xu Xinhai |
| author_facet | Ren Xiaoguang Xu Xinhai |
| author_sort | Ren Xiaoguang |
| collection | DOAJ |
| description | Computational fluid dynamics (CFD) simulation often needs to periodically output intermediate results to files in the form of snapshots for visualization or restart, which seriously impacts the performance. In this paper, we present asynchronous pipeline I/O (AP-IO) optimization scheme for the periodically snapshot output on the basis of asynchronous I/O and CFD application characteristics. In AP-IO, dedicated background I/O processes or threads are in charge of handling the file write in pipeline mode, therefore the write overhead can be hidden with more calculation than classic asynchronous I/O. We design the framework of AP-IO and implement it in OpenFOAM, providing CFD users with a user-friendly interface. Experimental results on the Tianhe-2 supercomputer demonstrate that AP-IO can achieve a good optimization effect for the periodical snapshot output in CFD application, and the effect is especially better for massively parallel CFD simulations, which can reduce the total execution time up to about 40%. |
| format | Article |
| id | doaj-art-47548650da9845f1853c5d63773eb30a |
| institution | Kabale University |
| issn | 2356-6140 1537-744X |
| language | English |
| publishDate | 2014-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | The Scientific World Journal |
| spelling | doaj-art-47548650da9845f1853c5d63773eb30a2025-02-03T00:59:14ZengWileyThe Scientific World Journal2356-61401537-744X2014-01-01201410.1155/2014/273807273807AP-IO: Asynchronous Pipeline I/O for Hiding Periodic Output Cost in CFD SimulationRen Xiaoguang0Xu Xinhai1State Key Laboratory of High Performance Computing, National University of Defense Technology, Changsha, Hunan 410073, ChinaState Key Laboratory of High Performance Computing, National University of Defense Technology, Changsha, Hunan 410073, ChinaComputational fluid dynamics (CFD) simulation often needs to periodically output intermediate results to files in the form of snapshots for visualization or restart, which seriously impacts the performance. In this paper, we present asynchronous pipeline I/O (AP-IO) optimization scheme for the periodically snapshot output on the basis of asynchronous I/O and CFD application characteristics. In AP-IO, dedicated background I/O processes or threads are in charge of handling the file write in pipeline mode, therefore the write overhead can be hidden with more calculation than classic asynchronous I/O. We design the framework of AP-IO and implement it in OpenFOAM, providing CFD users with a user-friendly interface. Experimental results on the Tianhe-2 supercomputer demonstrate that AP-IO can achieve a good optimization effect for the periodical snapshot output in CFD application, and the effect is especially better for massively parallel CFD simulations, which can reduce the total execution time up to about 40%.http://dx.doi.org/10.1155/2014/273807 |
| spellingShingle | Ren Xiaoguang Xu Xinhai AP-IO: Asynchronous Pipeline I/O for Hiding Periodic Output Cost in CFD Simulation The Scientific World Journal |
| title | AP-IO: Asynchronous Pipeline I/O for Hiding Periodic Output Cost in CFD Simulation |
| title_full | AP-IO: Asynchronous Pipeline I/O for Hiding Periodic Output Cost in CFD Simulation |
| title_fullStr | AP-IO: Asynchronous Pipeline I/O for Hiding Periodic Output Cost in CFD Simulation |
| title_full_unstemmed | AP-IO: Asynchronous Pipeline I/O for Hiding Periodic Output Cost in CFD Simulation |
| title_short | AP-IO: Asynchronous Pipeline I/O for Hiding Periodic Output Cost in CFD Simulation |
| title_sort | ap io asynchronous pipeline i o for hiding periodic output cost in cfd simulation |
| url | http://dx.doi.org/10.1155/2014/273807 |
| work_keys_str_mv | AT renxiaoguang apioasynchronouspipelineioforhidingperiodicoutputcostincfdsimulation AT xuxinhai apioasynchronouspipelineioforhidingperiodicoutputcostincfdsimulation |