Minimax Bayesian Neural Networks

Robustness is an important issue in deep learning, and Bayesian neural networks (BNNs) provide means of robustness analysis, while the minimax method is a conservative choice in the classical Bayesian field. Recently, researchers have applied the closed-loop idea to neural networks via the minimax m...

Full description

Saved in:
Bibliographic Details
Main Authors: Junping Hong, Ercan Engin Kuruoglu
Format: Article
Language:English
Published: MDPI AG 2025-03-01
Series:Entropy
Subjects:
Online Access:https://www.mdpi.com/1099-4300/27/4/340
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Robustness is an important issue in deep learning, and Bayesian neural networks (BNNs) provide means of robustness analysis, while the minimax method is a conservative choice in the classical Bayesian field. Recently, researchers have applied the closed-loop idea to neural networks via the minimax method and proposed the closed-loop neural networks. In this paper, we study more conservative BNNs with the minimax method, which formulates a two-player game between a deterministic neural network and a sampling stochastic neural network. From this perspective, we reveal the connection between the closed-loop neural and the BNNs. We test the models on some simple data sets and study their robustness under noise perturbation, etc.
ISSN:1099-4300