• CG_DESCENT

  • Referenced in 135 articles [sw04813]
  • Algorithm 851: CG_DESCENT. A conjugate gradient method with guaranteed descent Recently, a new nonlinear ... conjugate gradient scheme was developed which satisfies the descent condition gTkdk ... extensive numerical tests and comparisons with other methods for large-scale unconstrained optimization are given...
  • Pegasos

  • Referenced in 103 articles [sw08752]
  • contrast, previous analyses of stochastic gradient descent methods for SVMs require Ω(1/ϵ2) iterations...
  • ADADELTA

  • Referenced in 57 articles [sw39429]
  • novel per-dimension learning rate method for gradient descent called ADADELTA. The method dynamically adapts ... computational overhead beyond vanilla stochastic gradient descent. The method requires no manual tuning ... learning rate and appears robust to noisy gradient information, different model architecture choices, various data...
  • SNLSDP

  • Referenced in 38 articles [sw05127]
  • starting point for a gradient descent method with backtracking line search to solve the smooth...
  • TIGRA

  • Referenced in 40 articles [sw02333]
  • presented. The TIGRA (Tikhonov-gradient method) algorithm proposed uses steepest descent iterations in an inner...
  • Wirtinger Flow

  • Referenced in 110 articles [sw34175]
  • initialization obtained by means of a spectral method, and then refines this initial estimate ... computational complexity, much like in a gradient descent scheme. The main contribution is that this ... patterns. We illustrate the effectiveness of our methods with various experiments on image data. Underlying...
  • BADMM

  • Referenced in 32 articles [sw20288]
  • Alternating Direction Method of Multipliers. The mirror descent algorithm (MDA) generalizes gradient descent by using ... paper, we similarly generalize the alternating direction method of multipliers (ADMM) to Bregman ADMM (BADMM...
  • LASSO

  • Referenced in 33 articles [sw02850]
  • gradient descent algorithm for LASSO LASSO is a useful method to achieve the shrinkage...
  • topopt_multi

  • Referenced in 23 articles [sw25723]
  • Cahn system and regularized projected steepest descent method. A new computational algorithm is introduced ... gradient flow of the objective functional by a fractional step projected steepest descent method...
  • hgm

  • Referenced in 2 articles [sw25628]
  • package hgm: Holonomic Gradient Method and Gradient Descent. The holonomic gradient method (HGM, hgm) gives ... difference equations. The holonomic gradient descent (HGD, hgd) gives a method to find maximal likelihood...
  • ADMM-Softmax

  • Referenced in 2 articles [sw32744]
  • solving multinomial logistic regression (MLR) problems. Our method is geared toward supervised classification tasks with ... quasi Newton, and a stochastic gradient descent method...
  • SEISCOPE

  • Referenced in 6 articles [sw19396]
  • which implement first-order methods (steepest-descent and nonlinear conjugate gradient) and second-order methods...
  • RMTL

  • Referenced in 1 article [sw41670]
  • network incorporation. Based on the accelerated gradient descent method, the algorithms feature a state...
  • GPFEM

  • Referenced in 3 articles [sw22222]
  • Pitaevskii energy: a steepest descent method based on Sobolev gradients and a minimization algorithm based...
  • DARTS

  • Referenced in 11 articles [sw36213]
  • discrete and non-differentiable search space, our method is based on the continuous relaxation ... efficient search of the architecture using gradient descent. Extensive experiments on CIFAR-10, ImageNet, Penn...
  • DNSPLIN1

  • Referenced in 2 articles [sw01235]
  • strain energy by a descent method with a Sobolev gradient in place of the standard...
  • etas_solve

  • Referenced in 2 articles [sw26918]
  • based on the steepest descent method and calculates exact gradient and Hessian using the automatic...
  • LSGA

  • Referenced in 1 article [sw02836]
  • segmentation. Level-set-based segmentation methods typically perform gradient descent minimization on an energy function ... features: the Gabor wavelet based textural segmentation method [1, 9], and the level-set based...
  • NESVM

  • Referenced in 6 articles [sw08753]
  • primal SVM. Then the optimal gradient method without any line search is adopted to solve ... current gradient and historical gradients are combined to determine the descent direction, while the Lipschitz ... smooth parameter and using the continuation method. Our experiments on census income categorization, indoor/outdoor scene...
  • DSelect-k

  • Referenced in 1 article [sw41672]
  • trained using first-order methods, such as stochastic gradient descent, and offers explicit control over...