def hybrid_forward(self, F, inputs):  <EOL>
outputs = self.ffn_1(inputs)<EOL>if self.activation:<EOL><INDENT>outputs = self.activation(outputs)<EOL><DEDENT>outputs = self.ffn_2(outputs)<EOL>if self._dropout:<EOL><INDENT>outputs = self.dropout_layer(outputs)<EOL><DEDENT>if self._use_residual:<EOL><INDENT>outputs = outputs + inputs<EOL><DEDENT>outputs = self.layer_norm(outputs)<EOL>return outputs<EOL>
Position-wise encoding of the inputs.

        Parameters
        ----------
        inputs : Symbol or NDArray
            Input sequence. Shape (batch_size, length, C_in)

        Returns
        -------
        outputs : Symbol or NDArray
            Shape (batch_size, length, C_out)