def entropy(self, params):
log_std = params[:, :, <NUM_LIT:1>]<EOL>return (log_std + <NUM_LIT:0.5> * (self.LOG2PI + <NUM_LIT:1>)).sum(dim=-<NUM_LIT:1>)<EOL>
Categorical distribution entropy calculation - sum probs * log(probs).
In case of diagonal gaussian distribution - 1/2 log(2 pi e sigma^2)