def _apply_pooling(self, sequence):
outputs = sequence[:, <NUM_LIT:0>, :]<EOL>return self.pooler(outputs)<EOL>
Generate the representation given the inputs.

        This is used for pre-training or fine-tuning a BERT model.