Summary:
Generalizations to enable building forward passes and param update
operations separately.

Reviewed By: rbgirshick

Differential Revision: D6827027

fbshipit-source-id: 9d2ace349b4ebdf8993baa2f2c1529e2c5ce751d