def next_token(self):
if self.lookahead:<EOL><INDENT>self.current_token = self.lookahead.popleft()<EOL>return self.current_token<EOL><DEDENT>self.current_token = self._parse_next_token()<EOL>return self.current_token<EOL>
Returns the next logical token, advancing the tokenizer.