Synthetic data as external control arms in scarce single-arm clinical trials.

An external control arm based on health registry data can serve as an alternative comparator in single-arm drug development studies that lack a benchmark for comparison to the experimental treatment. However, accessing such observational healthcare data involves a lengthy and intricate application p...

Full description

Saved in:
Bibliographic Details
Main Authors: Severin Elvatun, Daan Knoors, Simon Brant, Christian Jonasson, Jan F Nygård
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2025-01-01
Series:PLOS Digital Health
Online Access:https://doi.org/10.1371/journal.pdig.0000581
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832539975651950592
author Severin Elvatun
Daan Knoors
Simon Brant
Christian Jonasson
Jan F Nygård
author_facet Severin Elvatun
Daan Knoors
Simon Brant
Christian Jonasson
Jan F Nygård
author_sort Severin Elvatun
collection DOAJ
description An external control arm based on health registry data can serve as an alternative comparator in single-arm drug development studies that lack a benchmark for comparison to the experimental treatment. However, accessing such observational healthcare data involves a lengthy and intricate application process, delaying drug approval studies and access to novel treatments. Clinical trials typically comprise only a few hundred patients usually with high-cardinality features, which makes individual data instances more exposed to re-identification attacks. We examine whether synthetic data can serve as a proxy for the empirical control arm data by providing the same research outcomes while reducing the risk of information disclosure. We propose a reversible data generalization procedure to address these particular data characteristics that can be used in conjunction with any generator algorithm. It reduces the input data cardinality pre-synthesis and reverses it post-synthesis to regain the original data structure. Finally, we test a selection of state-of-the-art generators against a suite of utility and privacy metrics. The external control arm benchmark was generated using data from Norwegian health registries. In this retrospective study, we compare various synthetic data generation algorithms in numerical experiments, focusing on the utility of the synthetic data to support the conclusions drawn from the empirical data, and analysing the risk of sensitive information disclosure. Our results indicate that data generalization is advantageous to enhance both data utility and privacy in smaller datasets with high cardinality. Moreover, the generator algorithms demonstrate the ability to generate synthetic data of high utility without compromising the confidentiality of the empirical data. Our finding suggests that synthetic external control arms could serve as a viable alternative to observational data in drug development studies, while reducing the risk of revealing sensitive patient information.
format Article
id doaj-art-7c0c8132974147109fd888d4adac359f
institution Kabale University
issn 2767-3170
language English
publishDate 2025-01-01
publisher Public Library of Science (PLoS)
record_format Article
series PLOS Digital Health
spelling doaj-art-7c0c8132974147109fd888d4adac359f2025-02-05T05:33:36ZengPublic Library of Science (PLoS)PLOS Digital Health2767-31702025-01-0141e000058110.1371/journal.pdig.0000581Synthetic data as external control arms in scarce single-arm clinical trials.Severin ElvatunDaan KnoorsSimon BrantChristian JonassonJan F NygårdAn external control arm based on health registry data can serve as an alternative comparator in single-arm drug development studies that lack a benchmark for comparison to the experimental treatment. However, accessing such observational healthcare data involves a lengthy and intricate application process, delaying drug approval studies and access to novel treatments. Clinical trials typically comprise only a few hundred patients usually with high-cardinality features, which makes individual data instances more exposed to re-identification attacks. We examine whether synthetic data can serve as a proxy for the empirical control arm data by providing the same research outcomes while reducing the risk of information disclosure. We propose a reversible data generalization procedure to address these particular data characteristics that can be used in conjunction with any generator algorithm. It reduces the input data cardinality pre-synthesis and reverses it post-synthesis to regain the original data structure. Finally, we test a selection of state-of-the-art generators against a suite of utility and privacy metrics. The external control arm benchmark was generated using data from Norwegian health registries. In this retrospective study, we compare various synthetic data generation algorithms in numerical experiments, focusing on the utility of the synthetic data to support the conclusions drawn from the empirical data, and analysing the risk of sensitive information disclosure. Our results indicate that data generalization is advantageous to enhance both data utility and privacy in smaller datasets with high cardinality. Moreover, the generator algorithms demonstrate the ability to generate synthetic data of high utility without compromising the confidentiality of the empirical data. Our finding suggests that synthetic external control arms could serve as a viable alternative to observational data in drug development studies, while reducing the risk of revealing sensitive patient information.https://doi.org/10.1371/journal.pdig.0000581
spellingShingle Severin Elvatun
Daan Knoors
Simon Brant
Christian Jonasson
Jan F Nygård
Synthetic data as external control arms in scarce single-arm clinical trials.
PLOS Digital Health
title Synthetic data as external control arms in scarce single-arm clinical trials.
title_full Synthetic data as external control arms in scarce single-arm clinical trials.
title_fullStr Synthetic data as external control arms in scarce single-arm clinical trials.
title_full_unstemmed Synthetic data as external control arms in scarce single-arm clinical trials.
title_short Synthetic data as external control arms in scarce single-arm clinical trials.
title_sort synthetic data as external control arms in scarce single arm clinical trials
url https://doi.org/10.1371/journal.pdig.0000581
work_keys_str_mv AT severinelvatun syntheticdataasexternalcontrolarmsinscarcesinglearmclinicaltrials
AT daanknoors syntheticdataasexternalcontrolarmsinscarcesinglearmclinicaltrials
AT simonbrant syntheticdataasexternalcontrolarmsinscarcesinglearmclinicaltrials
AT christianjonasson syntheticdataasexternalcontrolarmsinscarcesinglearmclinicaltrials
AT janfnygard syntheticdataasexternalcontrolarmsinscarcesinglearmclinicaltrials