Yes, you can simply create a new file in the root directory or sub directory and implement the custom tokenizer class in it. Let's say you have a custom tokenizer called AnotherTokenizer in a file called component.py , simply reference it as follows:

pipeline:

- name: component.AnotherTokenizer

Please be noted that this tutorial was written for version 1.0. Rasa has been updated to v2 since then but the underlying concept is still the same with some minor difference. Kindly check the underlying WhiteSpaceTokenizer to see if there are any changes.