Speed-up with cuDNN
----------------------------------------------------------------------------------------------------------------------

cuDNN is a NVIDIA library for GPU-accelerated deep learning. One of its highlights is the optimized convolution operations tuned for speed up on NVIDIA GPUs. Here are 3 simple steps by which you can install cuDNN and make it work with PDNN:

1. Upgrade your CUDA driver if the version is <6.5

2. Download the cuDNN package and decompress it to /path/to/cuDNN. Add the path to the following environment variabiles:
   
> export CPATH=/path/to/cuDNN:$CPATH
> export LIBRARY_PATH=/path/to/cuDNN:$LIBRARY_PATH
> export LD_LIBRARY_PATH=/path/to/cuDNN:$LD_LIBRARY_PATH


3. Now cuDNN will be used automatically when you run PDNN. To verify if cuDNN is truly being used, add "
optimizer_including=cudnn" to THEANO_FLAGS

Depending on your GPU cards and experiment setups, you can expect 2~3x speed up on CNNs training.