def restore(self, hidden_state):
for callback in self.callbacks:<EOL><INDENT>callback.load_state_dict(self, hidden_state)<EOL><DEDENT>if '<STR_LIT>' in hidden_state:<EOL><INDENT>self.optimizer_initial_state = hidden_state['<STR_LIT>']<EOL><DEDENT>
Restore any state from checkpoint - currently not implemented but possible to do so in the future