• Davis King's avatar
    Made the dnn_trainer not forget all the previous loss values it knows about · dd62b0e2
    Davis King authored
    when it determines that there have been a lot of steps without progress and
    shrinks the learning rate.  Instead, it removes only the oldest 100.  The
    problem with the old way of removing all the loss values in the history was
    that if you set the steps without progress threshold to a really high number
    you would often observe that the last few learning rate values were obviously
    not making progress, however, since all the previous loss values were forgotten
    the trainer needed to fully populate it's loss history from scratch before it
    would figure this out.  This new style makes the trainer not waste time running
    this excessive optimization of obviously useless mini-batches.
    dd62b0e2
Name
Last commit
Last update
dlib Loading commit data...
docs Loading commit data...
examples Loading commit data...
python_examples Loading commit data...
tools Loading commit data...
.gitignore Loading commit data...
.hgignore Loading commit data...
.hgtags Loading commit data...
.travis.yml Loading commit data...
CMakeLists.txt Loading commit data...
MANIFEST.in Loading commit data...
README.md Loading commit data...
appveyor.yml Loading commit data...
setup.py Loading commit data...