Results 1 to 8 of 8
Sort by:

  • Zoneout
  • Referenced in 5 articles [sw36444]
  • Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations. We propose zoneout, a novel method ... regularizing RNNs. At each timestep, zoneout stochastically forces some hidden units to maintain their previous ... values. Like dropout, zoneout uses random noise to train a pseudo-ensemble, improving generalization ... various RNN regularizers, and find that zoneout gives significant performance improvements across tasks. We achieve...

  • Theano
  • Referenced in 95 articles [sw05894]
  • Theano is a Python library that allows you...

  • MNIST
  • Referenced in 264 articles [sw12859]
  • THE MNIST DATABASE of handwritten digits. The MNIST...

  • RMSprop
  • Referenced in 55 articles [sw22204]
  • RMSprop: Divide the gradient by a running average...

  • Adam
  • Referenced in 737 articles [sw22205]
  • Adam: A Method for Stochastic Optimization. We introduce...