
CG_DESCENT
 Referenced in 135 articles
[sw04813]
 Algorithm 851: CG_DESCENT. A conjugate gradient method with guaranteed descent Recently, a new nonlinear ... conjugate gradient scheme was developed which satisfies the descent condition gTkdk ... extensive numerical tests and comparisons with other methods for largescale unconstrained optimization are given...

Pegasos
 Referenced in 103 articles
[sw08752]
 contrast, previous analyses of stochastic gradient descent methods for SVMs require Ω(1/ϵ2) iterations...

ADADELTA
 Referenced in 57 articles
[sw39429]
 novel perdimension learning rate method for gradient descent called ADADELTA. The method dynamically adapts ... computational overhead beyond vanilla stochastic gradient descent. The method requires no manual tuning ... learning rate and appears robust to noisy gradient information, different model architecture choices, various data...

SNLSDP
 Referenced in 38 articles
[sw05127]
 starting point for a gradient descent method with backtracking line search to solve the smooth...

TIGRA
 Referenced in 40 articles
[sw02333]
 presented. The TIGRA (Tikhonovgradient method) algorithm proposed uses steepest descent iterations in an inner...

Wirtinger Flow
 Referenced in 110 articles
[sw34175]
 initialization obtained by means of a spectral method, and then refines this initial estimate ... computational complexity, much like in a gradient descent scheme. The main contribution is that this ... patterns. We illustrate the effectiveness of our methods with various experiments on image data. Underlying...

BADMM
 Referenced in 32 articles
[sw20288]
 Alternating Direction Method of Multipliers. The mirror descent algorithm (MDA) generalizes gradient descent by using ... paper, we similarly generalize the alternating direction method of multipliers (ADMM) to Bregman ADMM (BADMM...

LASSO
 Referenced in 33 articles
[sw02850]
 gradient descent algorithm for LASSO LASSO is a useful method to achieve the shrinkage...

topopt_multi
 Referenced in 23 articles
[sw25723]
 Cahn system and regularized projected steepest descent method. A new computational algorithm is introduced ... gradient flow of the objective functional by a fractional step projected steepest descent method...

hgm
 Referenced in 2 articles
[sw25628]
 package hgm: Holonomic Gradient Method and Gradient Descent. The holonomic gradient method (HGM, hgm) gives ... difference equations. The holonomic gradient descent (HGD, hgd) gives a method to find maximal likelihood...

ADMMSoftmax
 Referenced in 2 articles
[sw32744]
 solving multinomial logistic regression (MLR) problems. Our method is geared toward supervised classification tasks with ... quasi Newton, and a stochastic gradient descent method...

SEISCOPE
 Referenced in 6 articles
[sw19396]
 which implement firstorder methods (steepestdescent and nonlinear conjugate gradient) and secondorder methods...

RMTL
 Referenced in 1 article
[sw41670]
 network incorporation. Based on the accelerated gradient descent method, the algorithms feature a state...

GPFEM
 Referenced in 3 articles
[sw22222]
 Pitaevskii energy: a steepest descent method based on Sobolev gradients and a minimization algorithm based...

DARTS
 Referenced in 11 articles
[sw36213]
 discrete and nondifferentiable search space, our method is based on the continuous relaxation ... efficient search of the architecture using gradient descent. Extensive experiments on CIFAR10, ImageNet, Penn...

DNSPLIN1
 Referenced in 2 articles
[sw01235]
 strain energy by a descent method with a Sobolev gradient in place of the standard...

etas_solve
 Referenced in 2 articles
[sw26918]
 based on the steepest descent method and calculates exact gradient and Hessian using the automatic...

LSGA
 Referenced in 1 article
[sw02836]
 segmentation. Levelsetbased segmentation methods typically perform gradient descent minimization on an energy function ... features: the Gabor wavelet based textural segmentation method [1, 9], and the levelset based...

NESVM
 Referenced in 6 articles
[sw08753]
 primal SVM. Then the optimal gradient method without any line search is adopted to solve ... current gradient and historical gradients are combined to determine the descent direction, while the Lipschitz ... smooth parameter and using the continuation method. Our experiments on census income categorization, indoor/outdoor scene...

DSelectk
 Referenced in 1 article
[sw41672]
 trained using firstorder methods, such as stochastic gradient descent, and offers explicit control over...