Optimización

Consejos prácticos

• Siddha Ganju: "Contouring learning rate to optimize neural nets", O'Reilly Ideas, August 2017. https://www.oreilly.com/ideas/contouring-learning-rate-to-optimize-neural-nets

Gradientes sintéticos

• Max Jaderberg: "Decoupled Neural Interfaces Using Synthetic Gradients", DeepMind, August 2016. https://deepmind.com/blog/decoupled-neural-networks-using-synthetic-gradients/
• "Deep Learning without Backpropagation", Tutorial: DeepMind's Synthetic Gradients, iamtrask, March 2017. https://iamtrask.github.io/2017/03/21/synthetic-gradients/