Another data science student's blog

The 1cycle policy

Posted on Sat 07 April 2018 in Experiments • Tagged with Deep Learning, SGD, Learning Rate

Properly setting the hyper-parameters of a neural network can be challenging, fortunately, there are some recipe that can help.

How Do You Find A Good Learning Rate

Posted on Tue 20 March 2018 in Basics • Tagged with SGD, Learning Rate

This is the main hyper-parameter to set when we train a neural net, but how do you determine the best value? Here's a technique to quickly decide on one.