Short Paper - Quadratic minimization: from conjugate gradient to an adaptive Polyak’s momentum method with Polyak step-sizes
In this work, we propose an adaptive variation on the classical Heavy-ball method for convex quadratic minimization. The adaptivity crucially relies on so-called “Polyak step-sizes”, which consists of using the knowledge of the optimal value of the optimization problem at hand instead of problem par...
Saved in:
Main Authors: | Goujaud, Baptiste, Taylor, Adrien, Dieuleveut, Aymeric |
---|---|
Format: | Article |
Language: | English |
Published: |
Université de Montpellier
2024-11-01
|
Series: | Open Journal of Mathematical Optimization |
Subjects: | |
Online Access: | https://ojmo.centre-mersenne.org/articles/10.5802/ojmo.36/ |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
-
IMPROVING PREDICTION ACCURACY OF DEEP LEARNING FOR BRAIN CANCER DIAGNOSIS USING POLYAK-RUPPERT OPTIMIZATION
by: M Muthulekshmi, et al.
Published: (2024-12-01) -
On the Strong Convergence of a Sufficient Descent Polak-Ribière-Polyak Conjugate Gradient Method
by: Min Sun, et al.
Published: (2014-01-01) -
Extension of Modified Polak-Ribière-Polyak Conjugate Gradient Method to Linear Equality Constraints Minimization Problems
by: Zhifeng Dai
Published: (2014-01-01) -
Optimization of staggered array configurations to enhance the aerodynamic performance of Darrieus wind turbines
by: Yosua Heru Irawan, et al.
Published: (2024-08-01) -
An efficient modified HS conjugate gradient algorithm in machine learning
by: Gonglin Yuan, et al.
Published: (2024-11-01)