Automated Patient-specific Quality Assurance for Automated Segmentation of Organs at Risk in Nasopharyngeal Carcinoma Radiotherapy
Introduction Precision radiotherapy relies on accurate segmentation of tumor targets and organs at risk (OARs). Clinicians manually review automatically delineated structures on a case-by-case basis, a time-consuming process dependent on reviewer experience and alertness. This study proposes a gener...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2025-01-01
|
| Series: | Cancer Control |
| Online Access: | https://doi.org/10.1177/10732748251318387 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832542688587546624 |
|---|---|
| author | Yixuan Wang MD Jiang Hu MD Lixin Chen PhD Dandan Zhang PhD Jinhan Zhu PhD |
| author_facet | Yixuan Wang MD Jiang Hu MD Lixin Chen PhD Dandan Zhang PhD Jinhan Zhu PhD |
| author_sort | Yixuan Wang MD |
| collection | DOAJ |
| description | Introduction Precision radiotherapy relies on accurate segmentation of tumor targets and organs at risk (OARs). Clinicians manually review automatically delineated structures on a case-by-case basis, a time-consuming process dependent on reviewer experience and alertness. This study proposes a general process for automated threshold generation for structural evaluation indicators and patient-specific quality assurance (QA) for automated segmentation of nasopharyngeal carcinoma (NPC). Methods The patient-specific QA process for automated segmentation involves determining the confidence limit and error structure highlight stage. Three expert physicians segmented 17 OARs using computed tomography images of NPC and compared them using the Dice similarity coefficient, the maximum Hausdorff distance, and the mean distance to agreement. For each OAR, the 95% confidence interval was calculated as the confidence limit for each indicator. If two or more evaluation indicators (N2) or one or more evaluation indicators (N1) exceeded the confidence limits, the structure segmentation result was considered abnormal. The quantitative performances of these two methods were compared with those obtained by artificially introducing small/medium and serious errors. Results The sensitivity, specificity, balanced accuracy, and F-score values for N2 were 0.944 ± 0.052, 0.827 ± 0.149, 0.886 ± 0.076, and 0.936 ± 0.045, respectively, whereas those for N1 were 0.955 ± 0.045, 0.788 ± 0.189, 0.878 ± 0.096, and 0.948 ± 0.035, respectively. N2 and N1 had small/medium error detection rates of 97.67 ± 0.04% and 98.67 ± 0.04%, respectively, with a serious error detection rate of 100%. Conclusion The proposed automated patient-specific QA process effectively detected segmentation abnormalities, particularly serious errors. These are crucial for enhancing review efficiency and automated segmentation, and for improving physician confidence in automated segmentation. |
| format | Article |
| id | doaj-art-ea8454f08bf54189af52942fa1acc2a7 |
| institution | Kabale University |
| issn | 1526-2359 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | Cancer Control |
| spelling | doaj-art-ea8454f08bf54189af52942fa1acc2a72025-02-03T19:03:30ZengSAGE PublishingCancer Control1526-23592025-01-013210.1177/10732748251318387Automated Patient-specific Quality Assurance for Automated Segmentation of Organs at Risk in Nasopharyngeal Carcinoma RadiotherapyYixuan Wang MDJiang Hu MDLixin Chen PhDDandan Zhang PhDJinhan Zhu PhDIntroduction Precision radiotherapy relies on accurate segmentation of tumor targets and organs at risk (OARs). Clinicians manually review automatically delineated structures on a case-by-case basis, a time-consuming process dependent on reviewer experience and alertness. This study proposes a general process for automated threshold generation for structural evaluation indicators and patient-specific quality assurance (QA) for automated segmentation of nasopharyngeal carcinoma (NPC). Methods The patient-specific QA process for automated segmentation involves determining the confidence limit and error structure highlight stage. Three expert physicians segmented 17 OARs using computed tomography images of NPC and compared them using the Dice similarity coefficient, the maximum Hausdorff distance, and the mean distance to agreement. For each OAR, the 95% confidence interval was calculated as the confidence limit for each indicator. If two or more evaluation indicators (N2) or one or more evaluation indicators (N1) exceeded the confidence limits, the structure segmentation result was considered abnormal. The quantitative performances of these two methods were compared with those obtained by artificially introducing small/medium and serious errors. Results The sensitivity, specificity, balanced accuracy, and F-score values for N2 were 0.944 ± 0.052, 0.827 ± 0.149, 0.886 ± 0.076, and 0.936 ± 0.045, respectively, whereas those for N1 were 0.955 ± 0.045, 0.788 ± 0.189, 0.878 ± 0.096, and 0.948 ± 0.035, respectively. N2 and N1 had small/medium error detection rates of 97.67 ± 0.04% and 98.67 ± 0.04%, respectively, with a serious error detection rate of 100%. Conclusion The proposed automated patient-specific QA process effectively detected segmentation abnormalities, particularly serious errors. These are crucial for enhancing review efficiency and automated segmentation, and for improving physician confidence in automated segmentation.https://doi.org/10.1177/10732748251318387 |
| spellingShingle | Yixuan Wang MD Jiang Hu MD Lixin Chen PhD Dandan Zhang PhD Jinhan Zhu PhD Automated Patient-specific Quality Assurance for Automated Segmentation of Organs at Risk in Nasopharyngeal Carcinoma Radiotherapy Cancer Control |
| title | Automated Patient-specific Quality Assurance for Automated Segmentation of Organs at Risk in Nasopharyngeal Carcinoma Radiotherapy |
| title_full | Automated Patient-specific Quality Assurance for Automated Segmentation of Organs at Risk in Nasopharyngeal Carcinoma Radiotherapy |
| title_fullStr | Automated Patient-specific Quality Assurance for Automated Segmentation of Organs at Risk in Nasopharyngeal Carcinoma Radiotherapy |
| title_full_unstemmed | Automated Patient-specific Quality Assurance for Automated Segmentation of Organs at Risk in Nasopharyngeal Carcinoma Radiotherapy |
| title_short | Automated Patient-specific Quality Assurance for Automated Segmentation of Organs at Risk in Nasopharyngeal Carcinoma Radiotherapy |
| title_sort | automated patient specific quality assurance for automated segmentation of organs at risk in nasopharyngeal carcinoma radiotherapy |
| url | https://doi.org/10.1177/10732748251318387 |
| work_keys_str_mv | AT yixuanwangmd automatedpatientspecificqualityassuranceforautomatedsegmentationoforgansatriskinnasopharyngealcarcinomaradiotherapy AT jianghumd automatedpatientspecificqualityassuranceforautomatedsegmentationoforgansatriskinnasopharyngealcarcinomaradiotherapy AT lixinchenphd automatedpatientspecificqualityassuranceforautomatedsegmentationoforgansatriskinnasopharyngealcarcinomaradiotherapy AT dandanzhangphd automatedpatientspecificqualityassuranceforautomatedsegmentationoforgansatriskinnasopharyngealcarcinomaradiotherapy AT jinhanzhuphd automatedpatientspecificqualityassuranceforautomatedsegmentationoforgansatriskinnasopharyngealcarcinomaradiotherapy |