Deep Painterly Harmonization

Posted on Thu 03 May 2018 in Experiments • Tagged with Deep Learning, Style Transfer

In this article we'll decode the research article with the same name and get some cool results integrating random objects in paintings while preserving their style.


Continue reading

Pointer cache for Language Model

Posted on Thu 26 April 2018 in Experiments • Tagged with Deep Learning, NLP

You can easily boost the performance of a language model based on RNNs by adding a pointer cache on top of it. The idea was introduce by Grave et al. and their results showed how this simple technique can make your perplexity decrease by 10 points without additional training. This sounds exciting, so let's see what this is all about and implement that in pytorch with the fastai library.


Continue reading

The 1cycle policy

Posted on Sat 07 April 2018 in Experiments • Tagged with Deep Learning, SGD, Learning Rate

Properly setting the hyper-parameters of a neural network can be challenging, fortunately, there are some recipe that can help.


Continue reading