def tokenize(text):
stem = PorterStemmer().stem<EOL>tokens = re.finditer('<STR_LIT>', text.lower())<EOL>for offset, match in enumerate(tokens):<EOL><INDENT>unstemmed = match.group(<NUM_LIT:0>)<EOL>yield { <EOL>'<STR_LIT>':      stem(unstemmed),<EOL>'<STR_LIT>':    unstemmed,<EOL>'<STR_LIT>':       offset<EOL>}<EOL><DEDENT>
Yield tokens.

Args:
    text (str): The original text.

Yields:
    dict: The next token.