installed on windows via pip.

vector from that layer so that it can be reused in any computations.
Most layers won't use it but for some backward computations having it
allows them to be implemented more efficiently.

to just regular lists of parameters.

cuDNN.

need to deal with it.