A Novel Hyper-Heuristic Algorithm with Soft and Hard Constraints for Causal Discovery Using a Linear Structural Equation Model

Artificial intelligence plays an indispensable role in improving productivity and promoting social development, and causal discovery is one of the extremely important research directions in this field. Acyclic directed graphs (DAGs) are the most commonly used tool in causal modeling because of their...

Full description

Saved in:
Bibliographic Details
Main Authors: Yinglong Dang, Xiaoguang Gao, Zidong Wang
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/27/1/38
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832588569207635968
author Yinglong Dang
Xiaoguang Gao
Zidong Wang
author_facet Yinglong Dang
Xiaoguang Gao
Zidong Wang
author_sort Yinglong Dang
collection DOAJ
description Artificial intelligence plays an indispensable role in improving productivity and promoting social development, and causal discovery is one of the extremely important research directions in this field. Acyclic directed graphs (DAGs) are the most commonly used tool in causal modeling because of their excellent interpretability and structural properties. However, in the face of insufficient data, the accuracy and efficiency of DAGs learning are greatly reduced, resulting in a false perception of causality. As intuitive expert knowledge, structural constraints control DAG learning by limiting the causal relationship between variables, which is expected to solve the above-mentioned problem. However, it is often impossible to build a DAG by relying on expert knowledge alone. To solve this problem, we propose the use of expert knowledge as a hard constraint and the structural prior gained via data learning as a soft constraint. In this paper, we propose a fitness-rate-rank-based multiarmed bandit (FRRMAB) hyper-heuristic that integrates soft and hard constraints into the DAG learning process. For a linear structural equation model (SEM), soft constraints are obtained via partial correlation analysis. The experimental results on different networks show that the proposed method has higher scalability and accuracy.
format Article
id doaj-art-9d3a935ab5e7469c916ec9af3a3ddf4a
institution Kabale University
issn 1099-4300
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Entropy
spelling doaj-art-9d3a935ab5e7469c916ec9af3a3ddf4a2025-01-24T13:31:46ZengMDPI AGEntropy1099-43002025-01-012713810.3390/e27010038A Novel Hyper-Heuristic Algorithm with Soft and Hard Constraints for Causal Discovery Using a Linear Structural Equation ModelYinglong Dang0Xiaoguang Gao1Zidong Wang2School of Electronic and Information, Northwestern Polytechnical University, Xi’an 710129, ChinaSchool of Electronic and Information, Northwestern Polytechnical University, Xi’an 710129, ChinaSchool of Electronic and Information, Northwestern Polytechnical University, Xi’an 710129, ChinaArtificial intelligence plays an indispensable role in improving productivity and promoting social development, and causal discovery is one of the extremely important research directions in this field. Acyclic directed graphs (DAGs) are the most commonly used tool in causal modeling because of their excellent interpretability and structural properties. However, in the face of insufficient data, the accuracy and efficiency of DAGs learning are greatly reduced, resulting in a false perception of causality. As intuitive expert knowledge, structural constraints control DAG learning by limiting the causal relationship between variables, which is expected to solve the above-mentioned problem. However, it is often impossible to build a DAG by relying on expert knowledge alone. To solve this problem, we propose the use of expert knowledge as a hard constraint and the structural prior gained via data learning as a soft constraint. In this paper, we propose a fitness-rate-rank-based multiarmed bandit (FRRMAB) hyper-heuristic that integrates soft and hard constraints into the DAG learning process. For a linear structural equation model (SEM), soft constraints are obtained via partial correlation analysis. The experimental results on different networks show that the proposed method has higher scalability and accuracy.https://www.mdpi.com/1099-4300/27/1/38causal discoverystructural constraintstructural equation modelhyper-heuristics
spellingShingle Yinglong Dang
Xiaoguang Gao
Zidong Wang
A Novel Hyper-Heuristic Algorithm with Soft and Hard Constraints for Causal Discovery Using a Linear Structural Equation Model
Entropy
causal discovery
structural constraint
structural equation model
hyper-heuristics
title A Novel Hyper-Heuristic Algorithm with Soft and Hard Constraints for Causal Discovery Using a Linear Structural Equation Model
title_full A Novel Hyper-Heuristic Algorithm with Soft and Hard Constraints for Causal Discovery Using a Linear Structural Equation Model
title_fullStr A Novel Hyper-Heuristic Algorithm with Soft and Hard Constraints for Causal Discovery Using a Linear Structural Equation Model
title_full_unstemmed A Novel Hyper-Heuristic Algorithm with Soft and Hard Constraints for Causal Discovery Using a Linear Structural Equation Model
title_short A Novel Hyper-Heuristic Algorithm with Soft and Hard Constraints for Causal Discovery Using a Linear Structural Equation Model
title_sort novel hyper heuristic algorithm with soft and hard constraints for causal discovery using a linear structural equation model
topic causal discovery
structural constraint
structural equation model
hyper-heuristics
url https://www.mdpi.com/1099-4300/27/1/38
work_keys_str_mv AT yinglongdang anovelhyperheuristicalgorithmwithsoftandhardconstraintsforcausaldiscoveryusingalinearstructuralequationmodel
AT xiaoguanggao anovelhyperheuristicalgorithmwithsoftandhardconstraintsforcausaldiscoveryusingalinearstructuralequationmodel
AT zidongwang anovelhyperheuristicalgorithmwithsoftandhardconstraintsforcausaldiscoveryusingalinearstructuralequationmodel
AT yinglongdang novelhyperheuristicalgorithmwithsoftandhardconstraintsforcausaldiscoveryusingalinearstructuralequationmodel
AT xiaoguanggao novelhyperheuristicalgorithmwithsoftandhardconstraintsforcausaldiscoveryusingalinearstructuralequationmodel
AT zidongwang novelhyperheuristicalgorithmwithsoftandhardconstraintsforcausaldiscoveryusingalinearstructuralequationmodel