• Zoneout

  • Referenced in 5 articles [sw36444]
  • Zoneout: Regularizing RNNs by Randomly Preserving Hidden Activations. We propose zoneout, a novel method ... regularizing RNNs. At each timestep, zoneout stochastically forces some hidden units to maintain their previous ... values. Like dropout, zoneout uses random noise to train a pseudo-ensemble, improving generalization ... various RNN regularizers, and find that zoneout gives significant performance improvements across tasks. We achieve...
  • Theano

  • Referenced in 95 articles [sw05894]
  • Theano is a Python library that allows you...
  • MNIST

  • Referenced in 264 articles [sw12859]
  • THE MNIST DATABASE of handwritten digits. The MNIST...
  • RMSprop

  • Referenced in 55 articles [sw22204]
  • RMSprop: Divide the gradient by a running average...
  • Adam

  • Referenced in 737 articles [sw22205]
  • Adam: A Method for Stochastic Optimization. We introduce...