On Systems of Neural ODEs with Generalized Power Activation Functions
When constructing neural network-based models, it is common practice to use time-tested activation functions such as the hyperbolic tangent, the sigmoid or the ReLU functions. These choices, however, may be suboptimal. The hyperbolic tangent and the sigmoid functions are differentiable but bounded,...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Oles Honchar Dnipro National University
2024-08-01
|
| Series: | Journal of Optimization, Differential Equations and Their Applications |
| Subjects: | |
| Online Access: | https://model-dnu.dp.ua/index.php/SM/article/view/201 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|