tokenization_dictionary property Leave feedback

The dictionary of characters that defines whether a token is considered as a valid word or a separator when using external tokenization tools.

The dictionary defines how the text of documents is divided into terms, so it can be changed only while the index contains no documents and its status is IndexStatus.ready.

@property
def tokenization_dictionary(self):
    ...

• class DictionaryRepository