medacy.pipeline_components.tokenization.character_tokenizer.
CharacterTokenizer
Bases: object
object
A tokenizer that tokenizes on every character
_get_infix_regex
Custom infix tokenization rules :return:
_get_prefix_regex
Custom prefix tokenization rules :return:
_get_suffix_regex
Custom suffix tokenization rules :return:
add_exceptions
Adds exception for tokenizer to ignore. :param exceptions: an array of terms to not split on during tokenization :return: